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Chapter 1 


Functions of a Real Variable 


eee 
1.1 Introduction 


A teal valued function y = f(x) of a real variable x is a mapping whose domain S is a set of real 
numbers (in most of the applications S is an open interval (a, b) or a closed interval [a, b]) and whose 
codomain is R, the set of real numbers. The range of the function is the set {y= f(x): x€ R} 
is a subset of R. 

A real valued function f is said to be bounded above if | f (x) | < M and bounded below if 
Ff @) | 2m for all xe Sy,.So C S. 


The real positive finite numbers M and m are respectively called the upper bound and the lower 
bound of the function. 


, which 


1.2 Limits, Continuity and Differentiability 
Let f be a real valued function defined over S C IR. We define the distance function as 


A(x, X2) =| x.-x, |, x1,%,€ R. ges 


Let a be any real number. Then, the open interval Ns(a) = (a — 6, a + 5), 5 > 0 is called a 
6-neighborhood of the point a. The interval 0 < | x-a|< dis called a deleted neighborhood of a. 


1.2.1 Limit of a Function 


The function fis said to tend to the limit / as x — a, if for a given positive real number € > 0, we can 
find a real number 6 > 0, such that 


|f(x)-l|<6€, whenever 0<|x-al<6. (1.2) 
Symbolically, we write lim f(x) =f, (1.3) 
Let f and g be two functions defined over S and let a be any point, not necessarily in S. Let 


lim f(x) =; and lim g(x) = 1, 
A t X= il 
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exist. Then, we have the following properties: 
(i) lim [cf(x] =e jim f(x) = ¢|,,¢ a real constant. 


(ii) lim [ f(x) + g(x)] = fim f(r) + lim g(*) =1, th. 

veow, i _ ae vax h | Bes (x)= bl 

(iii) lim (f(x) g(x)| =| lim f(x) | lim g(x) | =4h. 
k—d L474 rod | 


(iv) lim [f(x)/g(x)J = im, f(49 |/| fi g()| = |,/l,, provided 1, # 0. 
(v) lim (£1 = (1). 


Right hand limit Let x>aandx—a from the right hand side. If 


lf (x-l|<€& a<x <a+6, or lim f(x)=/; (| A) 


x—a* 


then, /, is called the right hand limit. 
Left hand limit Let x < a and x — a from the left hand side. If 


\f(x) -h| <6 a-d<x <a, oF lim f(x)=h (1.5) 


ra 


then, [, is called the left hand limit. 


If /; = i, then lim f(x) exists. If the limit exists, then it is unique. 
Example 1.1 Show that lim sin (1/x) does not exist. 
= 


Solution For different values of x in the interval 0 < | x | < 6, the function sin (1/x) takes values 
between —| and |. Since lim sin (1/x) is not unique, limit does not exist. 

x= 
Example 1.2 Show that lim, Lx? + 1] does not exist, where |-| is the greatest integer function. 


Solution Let h>0. We have 


lim f(4 +h) =L(4+h)? + 1J=L17+ h(h+ 8)J=17 if Ath+8)<1 


or (h+4)°<17, or he V17-4 
and lim f(4 -h) =L(4-h)? + 1J=L17 + Ath-8)|=16 if A(h—8)>-1 
Or 


(h-4)?>15 or h>4- +15. 
Theref 
ore, dim, f(x) = 17 and lim f(x) = 16. 
x— 47 


The limit does not exist. 
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1.2.2 Continuity of a Function 
aa ee a real valued function of the real variable x. Let xo be a point in the domain of f and let f be 
in some neighborhood of the point x9. The function f is said to be continuous at x = x9, If 
(i) lim f(x) =I exists and (ii) im f(x) =f (%). (1.6) 


Alternately, fis said to be conti if gi 
’ tinuous at a point Xp € J, if given any real positive } ; 
exists a real 6 > 0, such that ° . , , a nt 
ss | f (x) —f (xo) |< €& whenever |x —-2x9|< 6. (1:7) 
Note that 6 depends on both € and the point xo. If a function f is continuous at every point in an 
interval J, then f is said to be continuous on /. | 

A point at which f is not continuous is called a point of discontinuity. 


If ae f(x) = I exists, but im, f(x) #f (xo), then the point xp is called a point of removable 


discontinuity. In this case, we can redefine f(x), such that f(xo) = J, so that the new function is 
continuous at x = x9. For example, the function 
(sinx)/x, x #0 


fo= {4 " saedt 


has a removable discontinuity at x = 0, since lim, f(x) = 1 and a new function can be defined as 
x= 


(sinx)/x, x #0 


pops | ree 


so that it is continuous at x = 0. 
Continuous functions have the following properties: 
1. Let the functions f and g be continuous at a point x = 9. Then, 
(i) cf, ft g and f'g are continuous at x = Xo, where c is any constant. 


(ii) f/g is continuous at X = Xo, if g (Xo) # 0. 
2. If fis continuous atx = Xo and g is continuous at f (xo), then the composite function o(f (x)) 1s 


continuous at x = Xp. 
3. A function f is continuou 
lim f(x)=f(a) and lim f(x) =f(6). 

. xd” 


x—@a 
4, If fis continuous at an interior point c of a closed interval [a, b| and f(c) # 0, then there exists 


a neighborhood of c, throughout which f (x) has the same sign as f (c). 
5. If fis continuous in a closed interval [a, b], then it 1s bounded there and attains its bou 
once in [a, 5]. 
6. If fis continuous inaclosed interval [a, 5] and f(a), f(b) are of opposite signs, 
at least one point c € [a, b] such that f (c) = 0. 


us in a closed interval (a, b] and f (a) #f (6), then it assum 
is known as intermediate value theorem). 


s in a closed interval [a, 5], if it is continuous at every point in (a, 5), 


nds at least 
then there exists 


es every Value between 


7. If fis continuo 
f (a) and f (b). (This result 


ontinuity A function f (x) is said to 


be piecewise continuous in an interval /, if the 


Piecewise c 
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interval can be subdivided into a finite number of subintervals such that f (x) is continuous in each 
of the subintervals and the limits of f (x) as x approaches the end points of each subinterval are finite. 
Thus. a piecewise continuous function has finite jumps at one or more points in J. 

For example, the function 


Ll, O<x <I] 
2, Lsx<2 
Se 3, 2Lx 65 
4. 3S 2 5.4 


is continuous in each of the subintervals and has finite jumps at the points x = 1, 2, 3. The magnitude 
of these jumps is 1. 


Uniform continuity In the definition of continuity given in Eq. (1.7), the value of 6 depends both 
on € and the point x9. However, if a value of 5 can be obtained which depends only on € and not on 
the choice of the point xp in J, then the function fis said to be uniformly continuous. Thus, a function 
fis uniformly continuous on an interval J, if for a given real positive number € > 0, there exists a real 
6 > 0 such that 


| f (%2) —f (x) |< & whenever | x.-2x,|<6 (1.8) 


for arbitrary points x,, x in I. 
Obviously, a function which is uniformly continuous on an interval is also continuous on that 
interval. 


_ Example 1.3. What value should be assigned to 


f(x) = 1 54x21 


1 ly 





at x = 1, so that it is continuous at x = 1. 


Solution Let x = 1 + 4. Then, h > 0 as x > 1. We have 


CC a a, re Pa 


~ 1B ) 
te 1-[1+5h+ 00") 


Therefore, lim f(x) = 3. 
x—] 


Hence, if we assign f (1) = 3, the function will be continuous at x = l. 
Example 1.4 Prove that the function f defined by 


r x iS irrati 
fixi= when x is irrational] 


—1, when x is rational 
is discontinuous at every point. 


Solution Let x = a be any rational number so that f (a) 
an infinite number of rational and irrational numbers. 
choose an irrational number a, such that | a, —a |< Ln. 


f (a,) = 1 for all n and f(a) =- 1. Hence, 
at all rational points. 


= — |. Now, in any given interval there lie 
Therefore, for each positive integer n, we can 
Thus, the sequence {a,,} converges to a. Now, 
jim f (a, ) # f(a). Therefore, the function is discontinuous 
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Now, let x = b be anv |; a | 
slate’ aaeeahs ame panes number and f(b) = 1. For each positive integer n, we can choose 
f(b,) =— 1 for all n and f (b) a on b < I/n. Thus, the sequence {b,} converges to b. Now, 

: = 1. Hence, lim nme | 
at all irrational points. & aif (On) # f(b). Therefore, the function is discontinuous 
Hence, the given function ts discontinuous at all points. 


Exa : 
xample 1.5 Show that the function f (x) = x° is uniformly continuous on [-1, 1]. 


Solution We have 
If 2) — f (x) | = | x5 ~*7 | = | 35 =x, || xp +x, | <2| x --x, | ae, 


whenever | x. — x, | < €/2 = 6, 
Thus, for as €/2, | f (x2) — f (x1) | < €, whenever | x2 — x; | < 6 for arbitrary x,, x. € [-1, 1]. Hence 
the function x* is uniformly continuous on [-1, I]. | | 


Example 1.6 Show that the function f (x) = sin (1/x) is continuous and bounded on (0, 2/7), but it 
is not uniformly continuous there. | | 


Solution since both the functions 1/x and sin (1/x) are continuous for all x # 0, the given function 
1s continuous for all x # 0. Also, since | sin(1/x) | < 1, it is bounded there. Thus, on (0, 2/7), f (x) is 
continuous and bounded. Let € > O be given. Choose € = 1/2. Consider the points x, - In) 
and x» = 2/[2n + 1)z]. Both the points lie in the given interval, that is x, x. € (0, 2/7). We have 





. (2n4+1 | 
lf (x2) - f(a) | = sin ASDF _ sina | =1>€= 3 
.  . oe er or 








can be made arbitrarily small by choosing n sufficiently large. Therefore, | x. — x, | < 0. However, no 
matter how small &5> 0 may be, | x2 — x, | < 0 cannot ensure | f (x2) — f (x) | < €. Thus, the function 


sin (1/x) is not uniformly continuous on (0, 2/7). 


1.2.3 Derivative of a Function 


Let a real valued function f (x) be defined on an interval / and let x9 be a point in J. Then, if 


_ f(x) ~ fo) an Tes f (xq + Ax) —f(xX0) Ag) 
x 3X0 xX — XQ Ax—-0 Ax 


exists and is equal to /, then f(x) is said to be differentiable at xj and / is called the derivative of f(x) 
at x = Xo. If f(%) is differentiable at every point in the interval (a, b), then f(x) is said to be 
differentiable in (a, 5). If the interval [a, b] is closed, then at the end points a and b, we consider one- 
: ine 


sided limits. Geometrically, the derivative of f (x) at a given point P gives the slope of the tangent I 


to the curve y =/ (x) at the point P. 


The following properties are satisfied by 
be differentiable at a point x9. Then, 


the differentiable functions. 


1. Let the functions f and 8 
(i) (cf’) (%o) = cf’ (xo). ¢ any constant. 


(ii) (f+ g) (Xo) = f’(Xp) £ 8°). 
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(iii) (fg) (xo) =F Oo) 8 (Xo) + FX) 8'(%0). 
f\ Xo) 8'(%0) 
(iv) (z] (xp) = ne. a 
(Xo) 


2. If f is differentiable at x9 and g is differentiable at f (x9), then the composite function 
h = g(f(x)), is differentiable at x9 and h’(xo) = g°(f(%)) f’ (x9). 

3. If the function y = f(x) is represented in the parametric form x = Q(t), y= W(t), J) <t<Tand 
o’(t), w(t) exist, then 


g(x,) #0. 


dyldt _ y(t) 
f(x)= dxidt ~ Oty’ , Q(t) #0. (1.10) 


Higher order derivatives The derivative of f (x) at any point x, if it exists, is again a function of 
x, say f"(x) = g(x). If g(x) is differentiable at x, then we define the second order derivative of f (x) as 
d2 
f(x) = g(x) = oe 


Similarly, we define the nth order derivative of f as 


f(x) = (SF I- as 








dx" dx" 


The existence of the th order derivative f(x), implies the existence and continuity of f, f’ a 
f-» in a neighborhood of the point x. 


Leibniz formula Let f and g be two differentiable functions. Then, the nth order derivative of the 
product fe is given by the Leibniz formula as 


Fg) = "Co f(x) g(x) + "Cy FOP) a(x) + CFR) BR) + + "C, Fe) 2D). 


(1.41) 
This formula can be proved by induction. 


Example 1.7 Show that the function 


peay= | eee x #0 
, x= 


is differentiable at x = 0 but f(x) is not continuous at x= 0, 


Solution We have lim f(x) = 0 =f(0). Therefore, f (x) is continuous at x = 0. Now, 


f’'(0) = lim mi) 


= lim [x cos (1/x)] = 0 


Hence, f (x) is differentiable at x = 0 and f’(0) = 0. Forx# O, we have 


, l | 
f (x) = 2x cos G +2] sin (2) | - + = 2xcos (+) + sin (+). 
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Now, fim f’(x) does not exist as lim, sin (1/x) does not exist. Therefore, f(x) Is not continuous at 
1— 


x= 0. 
Example 1.8 Find the derivative of f(y) =x|x|,- 1S 4S 1. 


Solution We have 
f(xy) = ae 


The function is continuous for all x in [—l, 1]. 
For x € [—l, 0], we get 


ie : F(x — ax) — f(x) : l 4 + 
f ) = fi lim se i a ~ 2x. 


Ax 30 
Hence, f’(O-) = 0. 
For x € [0, 1], we get 
f(x + Ax) — f(x) © 


al . 
AX +0 Ax git. AX (x AX ) Xt | a 


Hence, f’(0*) = 0. 
We find that f (x) is differentiable for all x in [- 1, 1] and the derivative function is given by 
. mie ge 
f(x) = . 
ax, ED of fC) =2 |x| 


Example 1.9 Find the equations of the tangent and the normal to the ellipse x + or = | at the 
2 2 


point (xg, yo) on the ellipse. 

Solution The slope of the tangent to the ellipse at the point (xy, yo) is given by m= (dy/dx); <4 yo) 

and the slope of the normal to the ellipse at the point (x9, yo) is given by m, = — I/m. 
Differentiating the equation of the ellipse, we obtain 


2 











a b*x 
m=(2) ~ "i and hy Ri 
FX 7} x9,¥0) a” Yo° m Bx 
Hence, equation of the tangent at (xo, yo) is given by 
b* xo “ 7 a } + + 
y-yYo=- Dip (X-—X9) OF yyga* —a°yy = — b°X xy + O° XxG 


4 


, 

Y¥o . Xp _ *Q Yo 

or ee ee eh ae l. 
b a a* b- 


Equation of the normal at (xo, Yo) 1s given by 





2 | 
a” yo 2 2 
y- Yo = bP (x—Xg) OF YAQd* ~ b*xg vg = aXVG — a™XO¥O 


0) 
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wi b*xoy — a°yox = (b° — a”) xyyo, 

Example 1.10 Find the fourth order derivative of e“* sin bx at the point x = Q. 
xX * 


Solution Let f(x) = e"*, g(x) = sin bx and F(x) =f (x)g(x). Using the Leibniz formula, we obtain 


FIO (x) = a (e“sin bx) = *Cy(e™) sin bx + *C, (e™)® (sin bx)’ 
x 





+ *C,(e%")” (sin bx)” + 4C,(e%) (sin bx) + 4C, e&® (sin bx) 
= e“*[a* sin bx + 4a°b cos bx — 6a7b ? sin bx — 4ab3 cos bx + b'sin bx} 


Hence, F'(0) = 4a*b ~ 4ab? = 4ab(a? — b’). 


Exercise 1.] 


From the first principles, show the following. 


! ) iA - 2. lim — = |. 
L. lim - sin { 4 =o h ar l+eo3 


3. lim (x - 3)" sen (x — 3) = 0,where sen is the sien function 
1—+3 
LE 2£>0 


sen(x)=4 0, x=0 
-I,x<9. 


4, lim xLl + xJ=0, where | xJis the greatest integer function. 
i - 

5S» lim e*) does not exist. 
De 


Obtain lim f(x), if it exists, in problems 6 to 16. 
r-tg 












lia in? a 
6. f(x)= a= 0. 7 f(x)= ee = |. 
8. f(x) = sin (e""), a= 9. 9. f(x) =[v+]x| J/x,a=0. 
Vi¢x-1] 2 
10. f(x) = ——. a=0. HN. f(x) = (x-2)2 eM? Gin 
an —! | 
12. f(x) = BO Ll <0, 13. fixy= SOPH = In + ge) 
}x-9¢j A n—| 
14. f(x) = Teco a=. 15. F(x) = SORTS tan ixta, — 
-_ CRE ht Boa | 
ale +234. 4 ps 
16. J(aj= a a= co, 


[1° +2? + cchy*P 


X, x rational 
—X, X uTational 
IS NOU Continuous at any point x # 0. Is jt continuous at x = 0? 


17. Show that the function f defined as f(x)= | 


18. 
19, 


20. 


21. 


22. 
23. 
24. 
25. 
26. 
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Find the points of discontinuity of the function f (x) = Lx], where |x| is the greatest integer function 


Discuss the continuity of the function f (x) =LxJ+ Vx—|x| atx = 1. 


|. xf x;..4 #0 


Show that the function f (x) = | is bounded in IR , though it is not continuous over any 


. | ,#= 
interval containing x = 0. 


Determine the values of a, b, c so that the function 


'sin(a+1)x +sinx 


. » ee O 

(x)= c , x=0 
x + bx? — Sx 

er i . eg 


is continuous for all x. 


Show that the function f (x) = x° is uniformly continuous on [0, 1] but not on [0, -). 


Show that the function f (x) = ~/x is uniformly continuous on [0, 1]. 





Show that the function f (x) = -— : is not uniformly continuous on (2, 3). 


Show that f (x) = cos x is uniformly continuous on [0, °). 


Show that f (x) = V1—x? is uniformly continuous on [0, 1]. 


In problems 27 to 31, find the derivative of the given function at the given point. 


27. 
29. 


31. 


x tan”! x + sec”! (1/x), at x = 0. 28. x cosh x — sinh x, at x = 2. 


(x + 1)? x? atx = 4. 30. e* In (cosec x), at x = 77/6. 


yx+ yx++¥x+.., , at any point x. 


In problems 32 to 37, find dy/dx, where y is defined implicitly. 


32. 


xy + xe + ye* — x’ = 0 at any point (x, y). 

x+y -—3 a xy =0, ais a constant, at x = a and y #a. 

y —cos (x—y) =O at x= 7/2 andy #0. 35. x” y* = 1 at any point (x, y). 
wey%a=(xt+y)* atx=ly=l. 37. (tan7'x)” + (y)'* = 1 at any point (x, y). 
Find dy/dx when x = a(t — sin ft), y= a(1 — Cos 1) att = 7/2. 

Find dy/dx when x = a(cos 0 + 6 sin 8), y = a(sin O— @ cos 8). 

Find the derivative of sin x° with respect to x. 





Find the derivative of sin™' € =) with respect to Vx. 

Find the derivative of (x)*"* with respect to (sin x)*. 

Show that the function f (x) = x’ sin (1/x), x # 0, f (0) = 0 is differentiable for all x € IR. Also, show 
that f’(x) is not continuous at x = 0. 

Find all values of a and J, so that the function 

tanx, x< 


ax+b, x20 


fo =| 
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and its derivative / (x) are continuous al x = 7. 


t the function 
(x — 1) tan (x/2), x #1 


pare} , eee 


is not differentiable at x = 1. 


45. Show tha 


lfx 
Xe 
x#0 


46. Show that the function f(x) = 4 1 +e! | 
0 x=0 


q 


is not differentiable at x = 0. 
d*y cos Xx 


47. If y = tan x + sec x, x # 7/2, then show that aot asina)? 
48. Ifx = (1+ In a/r? and y = (3 + 2 In d/t, then find d?y/dx?. 

49. Find the fourth order derivative of f (x) = e~ cos x. 

50. Find the nth order derivative of f (x) = (ax + b)", m > Nn. 

51. If y = xe”, then find d"y/dx" at x = 0. 

52, Find the nth order derivative of f (x) = Vax+b. 

53. Find the nth order derivative of f (x) = e™ sin (bx + c). 

54. If y = cos x, — (a/2) <x < (7/2), then find d”y/dx" at x = 0. 


55. If y = e45”'*, then find d"y/dx" at x = 0. 


1.3 Application of Derivatives and Taylor Series 


We now discuss some applications of derivatives like finding approximate values of a function, mean 
value theorems, increasing and decreasing functions, maximum and minimum values of a function 


and series representation of a function. 


1.3.1 Differentials and Approximations 


Let y mp (x) be u real valued differentiable function and xg be a point in its domain. Let x) + Ax be 
a point in the neighborhood of xp. Then, Ax may be considered as an increment in x. The corresponding 


increment in f (x) is given by 
Afo = Af (xo) = f (x + Ax) — f (x). 


From the definition of derivative, we have (see Eg. (1.9)) 


f . f(Xo + Ax) —f(x ) A 
= | : 0 f 
f'(x0) Ar-30 Ax = jim a (LIZ) 


Since f’(xp) exists, we can write from Eq. (1.12) that 


Afo _,, 
Ax ~f()+@ or Afy=f'(xp) Ax + @ Ax (1.13) 


where @ is an infinitesimal quanti 
| uantity dependent on Ax ! 
. and ter —% 
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(1) Principle part f’(x9) Ax, which is called the differential of f. 
(ii) Residual part @ Ax which tends to zero as Ax — 0. 


In the limit, the differential is also written as 


df (Xo) = dyg = f (Xo) ax. (1.14) 
Hence, an approximation to f(x + Ax) can be written as 
f(x + Ax) = f(xo) + f’(%) dx. (1.15) 


Differentials have application in calculating errors in functions due to small errors in the independent 
variable. We define | dy | as the absolute error; dy/y as the relative error and (dy/y) X 100 as the 
percentage error in computations. 


Example 1.11 Find an approximate value of 
y = 3(4.02)? — 2(4.02)>” + 8/+/4.02 . 
Solution Let a function be defined as 
y =f) = 3x" — 2x + 8) f/x. 


Let x) = 4 and Ax = 0.02. Then, we need an approximation to f (xp) + Ax) = f (4.02). The approximate 
value is given by (see Eq. (1.15)). 


f (4.02) = f (4) + (0.02) f°(4) 
We have f (4) = 48 — 2(8) + 8/2 = 36, 
f'(x) = 6x — 3x!” — 44°” and f’(4) =24- 6-4/8 = 35/2. 
Therefore, the required approximation is 
f (4.02) = 36 + 0.02 (35/2) = 36.35. 


Example 1.12 If there is a possible error of 0.02 cm in the measurement of the diameter of a sphere, 
then find the possible percentage error in its volume, when the radius is 10 cm. 


Solution Let the radius of the sphere be r cm. Volume of the sphere = V = 4zr7/3 and 
dr =+0.01 when r= 10 cm. 

Differentiating V, we obtain dV = 47 r'dr. 

When r = 10, we get from Eq. (1.14), dV = 47(10)* (+ 0.01) = + 477. 

Hence, the percentage error in volume is 


dV ' +127 |_ ; 
(4) x 100 = 100 Para = + 0.3 cubiccm. 


1.3.2 Mean Value Theorems 


We now state some important results. 


Theorem 1.1 (Rolle’s theorem) Let a real valued function f be continuous on a closed interval 
[a, b] and differentiable in the open interval (a, 6). If f(a) = f(b), then there exists 4 point c € (a, b) 
such that f’(c) = 0. 

(See Appendix 1 for proof). 
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Remark 1 
(a) Differentiability of f (x) in an open interval (a, b) is a necessary condition for the applicability 
of the Rolle’s theorem. | . 
For example, consider the function f (x) =|x|,-1 <x 1. Now, f (x) - continuous on [-1, |] 
and is differentiable at all points in the interval (—1, 1) except at the point x = 0. Now, 
L. #29 


rot sea 


does not vanish at any point in the interval (—1, 1). This shows that the Rolle’s theorem cannot 
be applied as the function f (x) is not differentiable in (—1, 1). 

(b) Rolle’s theorem gives sufficient conditions for the existence of a point c such that f(c) = 0. 
For example, the function 

0 [Sx 2 


Da 2S 


j= | 


a] 


is not continuous on [1, 3], but f’(c) = 0 for all c in [1. 3]. 

(c) Geometrically, the theorem states that if a function satisfies the conditions of Rolle’s theorem 
and has the same value at the end points of an interval [a, b], then there exists at least one point 
c,a<c <b where the tangent to the curve y = f(x), a <x < b is parallel to the x-axis. 


Theorem 1.2 (Lagrange mean value theorem) Let f be a real valued function which is continuous 
on a closed interval [a, b] and differentiable in the open interval (a, b). Then there exists a point c, 
a<c<_6 such that 


fi(c2 (1.16) 


(See Appendix | for proof). 
Remark 2 
(a) If f (a) = f (6), then Lagrange mean value theorem reduces to the Rolle’s theorem. 
(b) Geometrically, Lagrange mean value theorem states that there exists a point (c, f (c)) on the 


curve C: y=f (x), a <x <b, such that the tangent to the curve C at this point is parallel to the 
chord joining the points (a, f (a)) and (b. f (b)) on the curve. 


(c) Using Eq. (1.16), we can write 


min f‘(x)< 


acrsb 


f(b) - f(a) , 
“hag “et J Ok (1.17) 


 gSxeh 
Theorem 1.3 (Cauchy mean value theorem) Let f(x) and 8(x) be two real valued functions defined 


on a closed interval la, b] such that (i) they are continuous on la, b], (ii) they are differentiable in 
(a, b) and (iii) g’(x) # 0 for every x in (a, b). Then, there Exists a point c € (q 5) such that 


f(b)-f(a)_ f’(c) 
8(b)— g(a) g’(c)’ 





a<c<b. (1.18) 
(See Appendix | for proof). 
Remark 3 


(a) For g(x) = x, Cauchy mean value theorem reduces to Lagrange mean value theorem 
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(b) Let a curve C be represente 


d parametrically asx=f(t), y=p) nerehT oo 
value theorem states that th . fO.¥ 8(#),a <t< b. Then, Cauchy mean 


, ; ere exists a point ( f(c), 2(c)), ce (a, b) on the curve such that the 
—_ 8 (c)/f’(c) of the tangent to the curve at this Point is equal to the slope of the chord 
joining the end points of the curve. Hence, Cauchy mean value theorem has the same geometrical 
interpretation as the Lagrange mean value theorem. 


(c) Cauchy mean value theorem cannot be proved by applying the Lagrange mean value theorem 
separately to the numerator and denominator on the left side of Eq. (1.18). If we apply the 
Lagrange mean value theorem to the numerator and the denominator separately, we obtain 


f(b) - f(a) _ FF tex) 


g(b)- g(a) g’(e) 9 <1 <9 <2 <b # ep. 


Example 1.13 A twice differentiable function f is such that f(a) = f(b) = 0 and f(c) > 0 for 
a<c <b. Prove that there is at least one value ¢,a<€&<hb for which f”(& <0. 

Solution Consider the function f(x) defined on [a, b]. Since f(x) exists, both fand f’ exist and are 
continuous on [a, b]. Let c be any point in (a, b). Applying the Lagrange mean value theorem to F(x) 
on [a, c] and [c, 5] separately, we get 


Lie) ~ f(a) = f'(€)), as E < Cc, and Oi) = f’(€2), c< G2 < b. 
Using f(a) = f(b) = 0, we obtain from the above equations 


f(c) 


c-d@ 





f(Ey= 2S and f(g) 2-2. 


Now, f"(x) is continuous and differentiable on [&,, &]. Using the Lagran ge mean value theorem again, 
we obtain 


Lon) =f tov) = f'"(6), 61 <6 < &2. 
G2 — Si 


Substituting the values of f’(&,) and f’(€3), we get 


‘ FOP) fod yg hy OE) ee, 
a ee ee gore (b-c)(c-a)(€,-&) ~ 


Example 1.14 Using the Lagrange mean value theorem, show that 
| cosb -—cosa|<|b-a|. 


Solution Let f(x) = cos x, a <x <b. Using the Lagrange mean value theorem to f (x), we obtain 





cos b= c0S4 ~ ¢’(¢) =~ sinc, or sae d =|-sinc| <1. 
b- —_ 





Hence, the result. | | 
Example 1.15 Let fiy= WG= x*) and f (0) = 1. Find an interval in which f (1) lies. 
Solution Using Eq. (1.17), we obtain for a = 0 and b = 1 

(1) — f (0) é 
min f'(x)S LM) -FO) 2 =f < max f’(x) 
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. ) ¥ ae | 
or vain, | 5 z]s fi i<jmax, [st 


— 
| l 4 e I< 
+ Sf(-1S5, oF z SJ S 9: 


: . ne v-acng.0<@< 

Example 1.16 Let C be acurve defined parametrically as v= a cos 0. y=a sin 6, 0 ‘s 0 ; 7/2. Deter- 
mine a point P on C, where the tangent to C is parallel to the chord joining the points (a, 0) and (0, a). 
Solution We have x = f(8)=acos’@ and y=g(@)=4 sin°@. Using the Cauchy mean value 


theorem, we have at some point 0 1 (0 
slope of tangent to C = slope of the chord joining the points (a, 0) and (0, a) 


oT 


g(@)  3asin*?@cos @ _ a — 0 


. a 4 ; 
f'(@)  -—3acos*@sin @ Q0-a 





or —~tan@=-1, or 0=/4. 
Therefore, the required point is (a/2¥2. a/2V2). 


1.3.3 Indeterminate Forms 


Consider the ratio f (x)/g(x) of two functions f (x) and g(x). If at any point x = a, f (a) = g(a) = 0, 
then the ratio f (x)/g(x) takes the form 0/0 and it is called an indeterminate form. The problem is to 


determine ‘im Lf(xVe(x)]. if it exists. Since f(a) = g(a) = 0, we can write 


fl) A= Fla) _ 4 @)-f@Wx- a) £) 
ry g(a) be g(x) g(a) ~ 5h [e(x) ~g(a)(a—a) ~ xt5e g(x) 








provided the limit on the right hand side exists. This result is known as L’ Hospital’s rule. 


L’ Hospital’s rule Suppose that the real valued functions f and g are differentiable in some open 
interval containing the point x = a (except may be at the point x = a) and f(a) = 0 = g(a). Then, 


_, £) zi a f(a) 
roa g(x) xd g(x) g(a) 








(1.19) 
Suppose now that f’(a) = 0 = g’(a). Then, we repeat the application of L’ Hospital’ ) ee 
and obtain ospital’s rule on f’(x)/g (x) 


F(x) _ FX) f(x) _ f(a) 
li | 
roa g(x) g(x) * g’(x) + ne e’(x) g(a) 








provided the limits exist. This applicati 
ad ee tg pplication of the rule can be continued as long as the indeterminate 
When both f(a) = + and g(a) = + o we get another indeterm; 

nile can bé applied. We-write ate form. In this case also L Hospital’s 


f(x) [I/g(x)] 
lj =_ ee 
roo g(x) FG] 
which is of 0/0 from. 


Remark 4 


(a) L’Hospital’ lec: 
Pital’s rule can be used only when the ratio is of indeterminate form, that is, either it is 
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of the form 0/0 or c0/ce. 


(b) The other indeterminate forms are 0 - 00, 0°, 00”, 1° and ce — oo. In each of these cases, we can 
reine the ratio function to the form 0/0 or 7 ad use this rule. For the indeterminate forms 
0°, co” and 1”, we take logarithm of the given function and then take the limits. 


(c) When the function isO of the form 0”,  - 0, 2 + 00, ©” or oo, it is not of indeterminate form 


and we cannot apply L’Hospital’s rule. We note that 0™ = 0, oc - 00 = ce, oc + ce = co, oo” = cc and 


(d) L’ Hospital’s rule can also be applied to find the limits as x > + =. 
Example 1.17 Evaluate the following limits 
In (1 + x) is a ae ss eX 
(1) lim eal (11) lim [x (In ¥));, (111) jim - | 


Solution Using L’Hospital’s rule, we get 





(i im | PEF | = im MEX - 

x30 sin x x30 COSX 
” 3 aaa [ie]. ge Se” 
(ii) lim [x”-(In-x)] = lim bret] em ott] : 0: 
usc , e~ |_ 4: e _— 
a) pe. = = jim | |- ) 


Example 1.18 Evaluate lim x”. 
x0 
Solution The given limit is of the form 0° which is an indeterminate form. Let y = x". 


Then, In y = x In x. Now, 


wiiticctitie |! Gee we! wx In x | 
ling (In y} = In| tim y | = ty (xn x] = fig | BE) 


= in = tin x= 
x0 [-]/x?] x0 


Therefore, lim y = e° = 1. 
x0 


Example 1.19 Evaluate lim x tan (1/x). 


Solution As x — ©, the function takes the form °° - 0. We first write it as lim Sornars which 1s 


of the form ce/ee. Applying the L’Hospital’s rule, we obtain 


{ 
—— 
lim x tan (1/x) = | ye cot (1/x) ~ oe (1/x7) cosec? (1/x) 


3 9 Fede A 

sin? (1/x) _ tiny HOY — tien ( SZ) 21 

— —— Ss 1m a Wm a? a 
yoo (1/x)? yO y yoo ) 


1.3.4 Increasing and Decreasing Functions 


Let y = f(x) be a function defined on an interval / contained in the domain of the function f (2)- Le 
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X), X» be any two points in /, where x,, x2 are not the end points of the interval. On the interval | the 
]> +2 ; > 


function f (x) is said to Ue 
(i) an increasing function, if f (x,) < f (x) whenever x, < x5. 
(ii) a strictly increasing function, if f (x,) <f (x.) whenever x, < x5. 
(iii) a decreasing function, if f (x,) > f (x.) whenever x, < x. 
(iv) a strictly decreasing function, if f (x,) > f (x2) whenever x, < x. 
A function which is either increasing or decreasing in the entire interval / is called a monotonic 


function. 
Let a real valued function f defined on an interval /, have a derivative at every point x in /. Then, 


using the Lagrange mean value theorem, we have 


I (x2) — f(x) = f’(c), x, ZOR hy; 


AQ AY 
Therefore, we conclude that 


(1) fincreases in J if f’(x) > 0 for all x in J, 

(ii) f decreases in J if f’(x) < 0 for all x in J. 

Thus, a differentiable function increases when its graph has positive slopes and decreases when its 
graph has negative slopes. Now, if f’(x) is continuous, then f(x) can go from positive to negative 
values or from negative to positive values only by going through the value 0. The values of x for 
which f’(x) = 0 are called the turning points or the critical points. At a turning point, the tangent to 
the curve is parallel to the x-axis. On the left and right of a turnin g point, tangents to the curve have 


different directions. 

Example 1.20 Find the intervals in which the function f (x) = sin 3x, 0 < x < 7/2 is increasing or 
decreasing. 

Solution We have f’(x) = 3 cos 3x. Now, f(x) = 0 when 3x = 77/2, 37/2... . for positive x. 
Hence, x = 7/6 is the only turning point in (0, 2/2). We consider the intervals (O, 77/6) and 
(70/6, 77/2). We have in 


O<x < 7/6: f’(x) = 3 cos 3x > 0, f (x) is an increasing function, 
mM/6<x< 1/2: f’(x)=3 cos 3x < Q, f (x) is a decreasing function. 


Example 1.21 Show that for all x > 0 


2 
L—* <6" «logy 2. 


2 

Solution Let f (x) = e* + x - 1. Now, 
£@)= 1-—e" 5 0 forall x> 0. 
Hence, f (x) is an increasing function for all x > 0. Therefore, 
f(x) >f(0)=0, or e*4+x_] >QOor e*>1- x. 
2 

Now, consider g(x) = e*-1+x- 
We have g(x)=l-x-e* <0 for all x > O. 
Hence, g(x) is a decreasing function for all x > 0. Therefore, 
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Hr) < ¥(O) =), mw et cf —x~4+ 5 
2 


(' é ‘jf # 
Oombining the above Iwo results, we obtain 


£ 
r A 
b-¥e et [= e4 ZF 2>0 


1.3.5 Maximum and Minimum Values of a Function 


Let a real valued func 
_ cea, a function f(x) bye CONUAMUGUS ON 4 closed interval la. db}. Sincé a continuous function a 
oan the pe nh 7 seaie and attains these bounds at least once in the interval, we wish to deter- 
; AMS where f (x) attains these bounds. Let int j . , 

a ae a } Oe Xy be a point in (a, b) and I = (x, —h +h) 
be an infinitesimal} interval around ty. Then, the function f (x) is said to have a , ’ | 


lacal maximum (or a relative maximum) at the point xy, if f (c,) = f (x), for all x in J. 

local minimum (or a relative minimum) at the point 45, if f (xy) < f (x) for all x in I. 

T he points of local maximum and local minimurn are called the critical points or the stationary 
points, The values of the function at these points are called the extreme values. ° 

The following theorem gives the neces sary Condition for the existence of a local maximum/minimum. 


ia hs 1.4 | (First derivative test) Let f (x) be differentiable at x, € (a, b). Then, a necessary 

condition for the function § (x) to have a local maximum or a local minimum at Xy is that f’(x9) = 0. 
Ata critical point, f'(x) changes direction. Thus, to find the local maximum/minimum values of 

the function in an interval /, we find the critical points in J by solving f’(x) = 0. B y studying the sign 

of f (x) as it passes through the critical point, we decide whether it is a point of local maximum 

(f(x) changes sign from positive to negative) or a point of loca! minimum (f’(x) changes sign from 

negative to positive). 

Example 1.22 Examine the functions 

(1) f (x) = x -3x+3,x%€ R , Gi fj=sinx,0O<cxcen 


for maximum and minimum values. 

Solution We have 

(i) f(x) = 3x? - 3. Now, f’(x) = 0 gives x = 1,-1. 
Por x < 1, f(x) < O and for x > 1, f(x) > 0. Since f’(x) changes sign from negative to positive as 
it passes through the critical point x = 1, the function has a local minimum value f(1) = 1 at x= 1. 


For x <- 1, f(x) > 0 and for x > — 1, f’(x) < 0. Since f’(x) changes sign from positive to negative 
as it passes through the critical point x = — 1, the function has a loca] maximum value f (-1) = 5 


atx =— |. 
(it) f'(x) = 2 sin x cos x = sin 2x = O at x = 7/2. 
Por x < 1/2, f(x) > 0 and for x > 1/2, f(x) < 0. Since f(x) changes sign from positive to negative 
as it passes through the critical point x = 7/2, the function has a local maximum value f (7/2) = | 
atx = n/2. 
Theorem 1.5 (Second derivative test) Let f (x) be differentiable at x). a < x) < b and let 
f' (xg) = 0. If f"Cc) exists and is continuous in a neighborhood of xo, then 
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h 


f'(xo +h) ~f'(%0) _ jn LOW = LOW 450 
: : = 


af ’ : 
xq) = lim 
f" (x0) h->0 Fgrer, 


Therefore, 
(i) f (x) has a maximum value at x = x9, when f”(%9) < 9: 
(ii) f (x) has a minimum value at x = xo, when f”(%o) > 9. 
When f(x) = 0, further investigation is needed to decide whether x = Xp is a point of local maximum 
or minimum. In this direction, we have the following result. 
Theorem 1.6 Let f(x) exist for x in (a, b) and be continuous there. Let 
f(a) = fi) = 0 LM) =O and f°"(%o) # 0 


Then, 


(i) when n is even, f (x) has a maximum if f(x) < 0 and a minimum if 
(ii) when n is odd, f (x) has neither a maximum, nor a minimum. 
n interval [a, b] are defined as follows: 


f@) + 0. 


Absolute maximum/minimum values of a function f(x) ina 
Absolute maximum value = max { f (a), f (b), all local maximum values}. 
Absolute minimum value = min { f (a), f (), all local minimum values}. 

Example 1.23 Find the absolute maximum/minimum values of the function 


f(x) = sin x (1 + cos x), 0<x < 27. 


Solution We have 
f (x) = sin x (1 + cos x) = sinx + : sin 2x, f’(x) = cos x + cos 2x. 

Setting f’(x) = 0, we get 

cosx+cos2x=0, or cosx+2cosx-l1=0, or cosx=-1, 1/2. 
Therefore, the critical points are x = 2/3, 7 and 57/3. 
Now, f(x) =-— sin x — 2sin 2x. 
At x = 2/3, f"(m/3) = — 3V3/2 <0. Hence, f (x) has a local maximum at x = 77/3 and the local 
maximum value is f (77/3) = 3-¥3/4. 
Atx= 7, f”(z) = 0. We find that 

f(a) =-cosx-—4cos2x and f”(2) =~—3+#0. 

Since, f (2) # 0 and n = 3 is odd, the function has neither maximum nor minimum at x = 7 
At x = 57/3, f"(Sm/3) = 33/2 > 0. Hence, f (x) has a local minimum at x = 52/3. The local 


minimum value is f (52/3) = -3-/3/4. 
We also have f (0) = (22) = 0. Therefore, 


absolute maximum value of f (x) = max { f (0), f (27), local maximum value at x = 77/3} 
= max {0, 0, 33/4} = 3./3/4. 


absolute minimum value of f (x) = min { f (0), f (27), local minimum value at x = 57t/ 3} 
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= min {0, 0, — 3./3/4} =- 3./3/4. 
Example 1.24 Find a right angled triangle of maximum area with hypotenuse h. 
Solution Let x be the base of the right angled triangle. The area of the right angled triangle is 


A(x) = axvh* —x*2, O<x<h. 


jh? =x? — x , = ht = 2x" = 2x" 
[p2 — x? 2-/h? — x? 


Setting A’(x) = 0 we obtain the critical point as x = h/-/2. 
Now, A(x) > 0 for x < h/-/2 and A’(x) < 0 for x > h/-j2. 
Therefore, A(x) is maximum when x = A/-/2 and the maximum area is A(h/ J2) = h/4. 


tro|— 


Now, A*(x) = 


t|— 


1.3.6 Taylor’s Theorem and Taylor’s Series 


A very useful technique in the analysis of real valued functions is the approximation of continuous 
functions by polynomials. Taylor’s theorem (Taylor’s formula) is an important tool which provides 
such an approximation by polynomials. Taylor’s theorem can be regarded as an extension of the mean 
value theorems to higher order derivatives. Mean value theorems relate the value of the function and 
its first order derivative, whereas the Taylor’s theorem relates the value of the function and its higher 
order derivatives. 


Theorem 1.7 (Taylor’s theorem with remainder) Let f(x) be defined and have continuous derivatives 
upto (m + 1)th order in some interval /, containing a point a. Then, Taylor’s expansion of the function 
f(x) about the point x = a is given by 


ees i _ a | 
p(x) = f(a) + FO pray + SSP pat. AAA f(a) + Ry (x) (1.20) 
— (eal const) 71 
where R, (x) = (n + 1)! f (c), accex (1. ) 


‘s the remainder or the error term of the expansion. 
Proof We first find a polynomial P,,(x), of degree n, which satisfies the conditions 


P, (a) = f(a), Pha) = f(a), k= 1,2, 050 
In a certain sense, P,,(x) is a polynomial approximation to f (x). Write the required polynomial as 
P, (x) = Co + C(% — a) + C4(X - a’ +... +¢,(x - a)". 
Substituting P,(x) in the given conditions, we obtain 
P.(a) = f(a) = Co, Pia) = f(a) = C1, Palla) = f(a) = 220-0 
P< (a) = f(a) = (a!) Cn. 


ee gl) =: | 
Hence, we have C, = as (a) K=O) Ly Qisasg ti 
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on -a)* 
Uherefore, f(x) = P(x) =f(a)+ 429 SAE pr, a) + +See "(ays 


The error of approximation is given by R(x) = f (x) — P(x). Therefore, 


I(x) = P,(x) + R,(x) = 2 (ea) h(a) + R,(x). 
Now, we derive a form of R,(x). Write R,(x) as 


(x-a 
R,(x) = 4 


yt 


h(x) 


where A(x) is to be determined. 


Consider the auxiliary function 
(x-1)" 


F(t) = f(x) - fo + (x- Of) +... 


= = ("+ (n+ DE 


x-a)" 
~ me at te, 


Wx) ac i<= 


We have f as a variable and x is fixed. The function F(t) has the following properties 


(1) F(t) is continuous in a < ¢ < x and differentiable in a < t < x, 
(ii) F(x) =0 
(x 


(iti) F(a) = f(x) - fa +(x-—a)f(a)+... 


=f (x) -f (x) = 0 


(x —a)" nye =)" 
+ Oe ms) 


Hence, F(t) satisfies the hypothesis of the Rolle’s theorem on [a, x]. Therefore, there exists a point 


c,a<e<x such that F’(c) = 0. Now, 


F(t) =0- mn ~ f(t) + (x- NF" - 


2 F(t) +. 





(n+ 1)(x-t 
(+ Di-0" 0 [= (x es [A(x) —fM"FD (ty) 


aes ne 
+ Sa peorny- (n+ 1)! 


F(c)=0= F=f) — fey 


and 
We obtain A(x) =f tle), Therefore, 


a yttl 
R, (x) = 158) _ pte} acc<x. 


(n+ 1)! 


The error term can also be written as 


( 
R,,(x) = caf (a + O(x-a)),0<0<1 


( 


which is called the Lagrange form of the remainder. 
Ita=0, we get 


(1.22) 
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F(x) = Q) pik f* x wv x" ) zal 
Ff Tel (QO) + 7 FO) # += FO) + eile). <c<x (1.23) 
which is called the Maclaurin’s theorem with remainder. 


If we neglect the error term in Eq. (1.20), we obtain 


f'"(a) (1.24) 


which is called the nth degree Taylor's polynomial approximation to f (x). 


n . Mm 
(Wa Pie F Yee 


=0 mi! 


Since ¢ in the remainde 7 i 
eae ce c or 9 in the remainder term (see Eqs. (1.21), (1.22)) is not known, we cannot evaluate 
n(x) exactly for a given x in the interval /. However, a bound on the error can be obtained as 





| | 2 (x = a)" . Se n+] _ 
Rn) |= | FOP Co) | S max SE | max | f(x) | eo) 
For a given error bound ¢, we can use Eq. (1.25) to determine 
(i) n for a given x and a, 
or (11) x = x* for a given n and a such that | R,(x*) | < €. 
Remark 5 
(a) Writing x = a + h in Eq. (1.20), we obtain 
f(a+hy~flay+ Apays Spray... + HK M(a), (1.26) 
The error of approximation simplifies as 
_ prt ki | 
R, (x) = fat pil (c) a<c<ath. (1.27) 


(b) Another form of the remainder R,(x) is the Cauchy form of remainder which is given by 
n+l : | | 
Ry (x) = = (1 - 6)" f"" (a+ Oh), O< O< 1. (1.28) 


(see Appendix | for proof). 
(c) Another form of the remainder R,(x) is the integral form of remainder, which is given by 
rath 


R,(x) = “ | (a+h—s)" f""'(s) ds (1.29) 


(see Appendix 1 for proof). 

Example 1.25 The function f (x) = sin x is approximated by Taylor’s polynomial of degree three 
about the point x = 0. Find c such that the error satisfies | Ry(x) | < 0.001 for all x in the 
interval [0, c]. 


Solution We have 


4 
i 


3 
f 0) =f (0) + x f (0) + % rf") + art 0). 





For f (x) = sin x, we obtain 
f’(x) = cos x, f (x) =-sinx, f(x) =—- cos x and f (x) = sin X. 


Hence, £0) = 1, £"(0) = 0, f’"(0) = - 1 and f(E) = sin S. 
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3 
vescwuil@incan. Hy ee x3 
The required approximation is f(x) = sin x = x - - 


The maximum error in the interval [0, c] is given by 


| R3(x)|= 





sing] <x. [5 02 pag, inal 


Now, c is to be determined such that 


4 4 
C_<09001 or c”* < 0.024. 
74 = 0.00 


We obtain c ~ 0.3936. Hence, for all x in the interval [0, 0.3936], this error criterion is satisfied. 
Taylor’s Series 
In the Taylor’s formula with remainder (Eqs. (1.20), (1.21)), if the remainder R,(x) — 0 as n - 00, 
then we obtain 
me " _ == a)" (n) 
fodv=Ftal + (2— 9) pr(qy 4 FR =a)" 2 (x7 a)" pay... + FRA fM(a) +... (1:30) 


which is called the Taylor’s series. When a = . we obtain the Maclaurin's series 


2 n | 
FR) =f 0) + F/O + L'O +... + HMO +. (1.31) 


Since it is assumed that f (x) has continuous derivatives upto (n + 1)th order, f ("+ 1)(~) is bounded in 
the interval (a, x). Hence, to establish that lim |R,(x)|=0, it is sufficient to show that 
hn—} oo 

| x -a lade . | 
im “Grol = 0 for any fixed numbers x and a. Now, for any fixed numbers x and a, we can 
ri? co é 


always find a finite positive integer N such that | x —a | < N. Denote g = |x -—a|/N. Then 


















































(x-a)™" | _ X—-al||x-a i X—a@ | x-a 
(n 4 | f l 2 N-] N n+] 
(x-a)N7 (x -—a)"-! 
ee fe el ‘0... = | 2c Sd a 
(N-TP [7°99 |" Naar | 4 
N | (x-a)*- |. , 2. 
ow, “iN. DE 1s a finite quantity and is independent of n. Also q < |. Hence 
(x —a)"*! 








(n+ I)! | = 0 for any fixed x and a, and lim | R, (x)|=0 


Example 1.26 Obtain the Taylor’s pol 
x = 1/4, Show that the error 
series expansion of f (x). 


Solution For f (x) = sin x, we have 


term wig expansion of the function f (x) = sin x about the point 
S tO Zero aS n > co for any real x. Hence, write the Taylor’s 


f(x) = = (- 1)" sin x and f@ + 


(x) = (-1)" cos x 
for any integer py. Therefore, 
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f (m14) = (-1)VV2 and f+ (/4) = (-1)7 V2. 


Hence, the Taylor’s expansion of f (x) = sin x about x = 7/4 is given by 


tix) =s( 4) + [+- 2) 7{ 2) +...+ 4 (x-4) f( £) +R, (x). 


Now, 


= 2n+l I - 2n+] 
2-8) £6) soe (*- 8) 


1 
axa 4 





| Ron (x) | = 





since fO""') = | (-1)” cos c | < 1. Hence, R2,(x) > 0 as n > ~. 


Similarly, we find that R,,,,(x%) >~ 0 asn > ~. 
Therefore, the required Taylor’s series expansion is given by 


It 


7) 3 
we ty tf. @) 1 [,.#) 1 (x #) 7 
etal ea G f) at ;) Bni2\* 4) ~ 
9 3 
1 1 
=f fte(s-8)-a(2- 3] -4(x-4) tn 


1.3.7 Exponential, Logarithmic and Binomial Series 





Exponential series 
Consider the Taylor’s polynomial approximation of degree < n about the point x = 0 for the 
f (x) = e*. The Taylor's polynomial approximation is given by 


function 


2 n : 
f(x) =fO+2S/'O+ Fl’ Or... + HO. 


For f(x) =e%, we obtain 


fl@= e* f'(0) = Lor= 0; gen _,nand f*"*” (x) =e". 


Hence, 


Using the Lagrange form of the remainder, we get 


n+l n+l ; 
R= Gael” = meme 





_ x tl Ax | 
OF aS R(X) = Ty ty © ; 0<@< 1. 


+1 
@x xX : Jen = 0 


~ im i + 1)! 





x"! 
(n+ 1 





Therefore, jim | Rn (x) | = lim 
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for all x, since e9x is bounded for a given x. 
Hence. we obtain the exponential series 


+t 32) 


Example 1.27 For the Taylor’s polynomial approximation of degree <1 about the point x = 0 fo, 
the function f (x) = e*, determine the value of n such that the error satisfies | Ry(x) | < 9.005, when 


=| Sx dL. 


Solution We have the Taylor’s polynomial approximation of e* as 


? n 


— ow x _& =. 
f(x) =e =k PES Py 





The maximum error in the interval [-1, 1] is given by 


x n+l 


(71+ 1)! 





Ft ¥ a 
$ E ay | eas ens Ge 





| Rn (x) | = for (c) 


Now, 7 is to be determined such that 


— | |)! > 200 «€ 
fa + 1! < 0.005 or (n+ 1) e€ 


We find that n > 5. Hence, we will require at least 6 terms in the Taylor’s polynomial approximation 


to achieve the given accuracy. 
Example 1.28 Obtain the fourth degree Taylor’s polynomial approximation to f (x) = e** about 
x = 0. Find the maximum error when0O <x <0.5. 


Solution We have 


2 3 
f(x) = £(0) + xf'O) + 5, £0) + 5 FO) + FO) 


For f (x) = e*, we obtain f(x) = 2’e*, f (0) = 2", r=0, 1,2,... and fc) = 32 &*. 


‘ 4x* 8x? 16x4 
Therefore, f (x) = e~ Ht hbo et el + ee De + 3x3 + Ext. 


The error term is given by 


5. 
R4(x) = 7" @ = 3 Se, O0<c<x. 


32 
and | Ra(2) | 120 | max. P [om . = 120° 


Logarithmic series 


Consider the Taylor’s polynomial approximation of degree <n about the point x = 0 for the function 
f (x) = In (1 + x). The Taylor’s polynomial approximation is given by 
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f(x) =O) + xf") + 2 f"(O) +... + 2 60), 


For f (x) = In (1 + x), we obtain 





f(x) =In(1 +x), f(0)=0; f(x) = ! f’0) = 1; 


1+x’ 

r -1)""(r - 1)! 
F(x) =§ II OO) =A Dh 28a 
(n+1) _ (-1)" n! 
pax) Aiea 

= _1)2 (9! _y\r-1 ~ : 
Hence, f(x) =In(Q ities! ey? aS eS oe ..ope 1) a Ly! 
2 3 ‘ 
=X ; + 3 ...+(-l) a (1.35) 


We note that f (x) and all its derivatives exist and are continuous for -—1 <x < 1. 
Using the Lagrange form of the remainder, we get 








a ar) atte (—1)" n° 
Ru (X= yl (6x) = (n+1)! Ferd 


n n+l 
i “ ;,; Pee= 1. 


~ (n+1)| 1+ 0x 


We consider the following two cases: 


Case1l Let 0<-x < 1. Since 0 < @< 1, we have 


O<O@x<x<1 and —*—e<1. 
1+ 60x 


Therefore, we obtain 


n+1 
. =" | x : 
Pe = Bee oltees| =o 








Case 2 Let —-1 <x <0. Since0 < 6<1,|x/(1 + @x) | may or may not be less than 1. Hence, we 
cannot use the Lagrange form of the remainder to find lim | R,, (x) |. 


Now, consider the Cauchy’s form of the remainder. We have 


(-1)” (1 = 0)" yt 


n+] 
= 2] — 9)" F“" (x)= 
R, (x) (1 — 6)" fr" (8x) (ls Ox) 


n! 
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(-1)” ( 1-@ | 0< 6< 1. 




















~ (1 + Ox)\ 14 Ox 
Sj . 1-8 ] d _1l ie, 
inc 1+ Ox | >>" 3 | ia Gx 1 -|x| 
| a | tlt |1-@ |" | 29 
we have in Ry (2)|< im | AEG 1 + Ox | 


Hence, we obtain 


2 3 ni xe _ <1. : 
In(l+x)=x-4-+4--...+(C0) 1S 4 yang SL EwS I (1.34) 


Note that for | x|> 1, lim | R, (x) | = ©. 
Writing 1+x=y or x=y-—1 in Eg. (1.34), we get 


) ae | n—| ” | 
Iny =(y- 1) - 509-1)? t... 4S —Ky-)) Hiney OSES (1.35) 


The series given in Eqs. (1.34) and (1.35) are called the logarithmic series. 


Binomial series 
Consider the expansion of the function (x + y)". We can write 
(x + yy" = x™ [1 + Q/x)J™ = x1 + z), where z = y/x. 


Therefore, it is sufficient to obtain the expansion of the function f(z) =(1 + z)™ or f(x) = (1 + x)”. 
Consider the Taylor’s polynomial approximation for the function f (x) = (1 + x)” about the point 
x = 0. We consider the following two cases. 


Case 1 When m is a positive integer, f(x) = (1 + x) possesses continuous derivatives of all orders 
and f'"(x)=0, r>m+ 1 for all x. We have 


f(x)=(1+x)", fO)=1; f’(x)=m(l4+x)™. f’(0) =m; 
f(x) = m(m - 1) (1 + x)": f°(0) = m(m — 1): ... 


f°" (x) = m(m-1)...2.1, f™(0) = mi and f(x) <0 ps. 


Therefore, we obtain 


7 * , 2 | m 
POV= (1+ x)" = F0) + xf0) + FF") 4... 4 rh (0) 
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m(m — 1) 
—-1+mxt ca yr eee Hx” 


("| "x3 ("ee oo "|" (1.36) 


xn! 
Rn(*) = Ta 1)! 
f(x) = (1 + x)™ possesses continuous 





We also have 

fr (c) = 0, n2m. 

Case 2 When m is nota positive integer, derivatives of all 
orders provided x # -I. 

Let -1 <x < 1. We have 


ye 


FO) (x) = m(m — 1). -- (m - n)(1 +x 
Using the Cauchy’s form of the remainder, we get 
n+l 
R,, (x) — =—-( = @)" fo"? (Ox) 


= 2" (1 - 6)" m(m - 1)...(m—n)(1 + Ox 


not 








m(m — 1)...(m—n) 1-6)" m-1 _ ntl 
_ PAE DD ee SE | | 
“ — (a: (1+ oxy™tx™!, O< O<1. (1.37) 
Now, for! x|< 1, 0< 1-0 <4 and 
1 + Ox 
fm (2-8) <0, limixi™ =0, lim m(m—1)...(m—") | _, 
nol 1 + OX neo n— oo n! 


where ais a finite quantity. Since (1 + x)M-I is independent of n and bounded, we obtain from Eq. (1.37) 


lim 1 R, (x) | = 0. 


Therefore, when m is not a positive integer and | x | < 1, we obtain 


I _ 4 
flea 14 met MDa, 4 MOD yn (1.38) 


Alternative proof 

Consider the series » a, where @, = mn)” x". 
Using the ratio test, we get | 

_ | (m-n-—l) 


= | i AS 
nw | Ane dD 





s ix. 








im, 
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Hence, the senes (1.38) converges for =] < ¢ < | 
Further, it can be shown that the binomial series (1.38) converges atv = | when m > — 1, 
For example. consider the series 
- , 1 

(lL + x) _ l—-xt2x -xX +. 
Fora = 1, the senes on the right hand side has two limit points 0 and | and hence the series ig poy 
eOonvergent. 
We have the following binomial series 














(1 +x)" = 1 — 2x 4 3? -— 42° + =] 6.x] 
Th | P39 1°3°5 23 — fe ee 1. 
(Ltsy" =1 S447 "a4. 6" +. F 
Bi a foe Ne ae es FE a Be dw ailing oS I. 
(1 +27) =l+gx-y7es +39 


Exercise 1.2 


Find the approximate values of the following quantities using differentials. 
1. (1005)'*. 2. (999)!9. 
3. (1.001) + 2(1.001)*5+ 5. 4. sin 60° 10’. 
5. tan 45° 5’ 30”. 
6. State why Rolle’s theorem cannot be applied to the following functions. 
(i) f (x) = tan x in the interval [0, z], (ii) f(x) = | x] in the interval [-1/2, 3/2], 
_ x ;« OSes ] 
wd sve eS 


7. It is given that the Rolle’s theorem holds for the function fw 


=x + bx? + cx, 1 <x <2 at the 
point x = 4/3. Find the values of b and c. 


8. The functions f (x) and g(x) are continuous on [a, b] and differentiable in (a, 6) such that f (a) =4, 
f (6) = 10, g(a) = 1 and g(b) = 3. Then, show that P'(c) = 3g'(c),a<ce<b. 


9. Prove that between any two real roots of e* sin x = l, there exists atleast one root of e*cosx+1= 


0). 
10. Let f’(x), 


g’(x) be continuous and differentiable functions on [a, 6]. Then, show that for a<c<b 
f(b) -f(a)-(b-a) f(a) fc) i 
g(b)- (a) =(b—a)g(a) g%eyr8 () #0. 
Il. Let f(x) be continuous on [a - 1, a + 1] and differentiable in 
0 < @< 1 such that f (a — I)-2f(a)+f@+l)=f(ad 0) 
12. Using the Lagrange mean value theorem, show that 
(i) e* >1+x, x>0; 


(iii) x<sin'x<x/VI-x? , Ocxe]. 


13. Suppose that f(x) is differentiable for al] 
all x, Show that f (0) = 0. 


14. Let F(x) and G(x) be two functions defined on [a, 
with G(x) ¥ 0 for any x in [a, b]. Show that ther 


(@—1, a+ 1). Show that there exists a 0, 
-f"(a- 6). 


(ii) In (1 tx)<x, x>0- 


values of x such that f(a) =a, f(—a) =—¢ and | f’(x) | < 1 for 


b] Satisfying the hypothesis of the mean value theorem 
€ €Xxists a point c in (a, b) such that 


Fib)-Flay Fcjy! Gi lc) 


(i(b) . (sla) G te) C10 GOB, 


Evaluate the limits in problems 15 to 2% 














15. lim -— 16. jim ce’ ~ 20 e+e” 
t+] x" = | afi KX afi Zz 
In (sina) : 
17, lim: — 18. lim 24-42 
Boni (fp Dy)? so ag gun’ x 
19. lim (1 = 4) tan (mx/2) 2. lim 7 Sal Se Roe 
to! s-02 1 x= 2 Infx—}) 
fie lim hl ZZ lm (una)? 
g— | roel 
23. lim S——=—!, say = 
93 1Xlim — £0, =0 a 
1-9) (x) f | 2A. im F 
f 
Qa £ 
25. lim [1 +f(x)|'!, lim fix) =0 2%. lim | 1++ 
re iv iam x | 
ee ff | 
x+4In. 
27. lim prriya 28. lum 
[-—7™ y X— CO" x icv A 2 J 


In problems 29 to 36, find the intervals in which f (x) is increasing or decreasing. 


29. In (2 + x) —2x/(2 + x), xe IR 3%. xsixL x€ R. 

31. tan! x+x, xe RR. 32. snx+|sinx|, O< x5 2% 
33. In(sinx), O< «<7. 34. (Inxs, x>O 

35. sinx (1 +cos x), 0< 4 < m2. 36. «*, «>0. 


37. Leta>b>O and n be a positive integer satisfying n 2 2. Prove that a’ - b’" <(a-b)"™ 
In problems 38 to 43, find the extreme values of the given function f (x). 


38. (x - 1) (x + 1)’. 39. sin x + cos x 
40. x'* 41. (sin xj” 
42. 2sinx+cos2x, 0S x5 22. 43. sin*x sin 2x + cos*x cos 2x, O< x< 


44. Show that the function f(x) = (ax + by/cx + d) has no extreme value regardless of the values of a, b.c, d. 
_ | —~x? + [(b’ ~h* +b-1)(b? +3b+2)|, OF «<1 
sas Lats had 2x-3 , Se $3. 
Find all possible real values of 6 such that f (x) has minimum value al x = 1 
[In problems 46 to 50, obtain the Taylor's polynomial approximation of degree n to the function f (x) about the 
point x = a. Estimate the error in the given interval. 
46. fix) = Vx.n=3,a=1,1524915, 47. fixyzeo! .n=3,a=0,-18191 
48. fj =xsinxs,n=4,a=90,-1 x61. 9. f(x)ax'e' .n=4,a=1,05Sx5 15 
50. f(x) = 1 ~x),n=3,a=0,05x%50.25. 


In problems 51 to 54, obtain the Taylor's polynomial approximation of degree n to the tuncuion f (x) about the 
point x = a. Find the error term and show that it tends to zero as n + ~ Hence, write its Taylor's senes. 


51. f(x) = sin 3x, a= 0. §2. f(x) =sin*x, a=0. 
53. flxy =x? Inx, a=. 54. fixy=2, a=. 
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55. 


56. 


57. 


58. 


59. 


60. 


Show that the number @ which occurs in the Taylor’s formula with sham ine “ achiem (given 
in Eg. 1.22)) after n terms approaches the limit I/(m + 1) as h — O provide UOUS and 
not zero at x = d. | . 

Find the number of terms that must be retained in the Taylor’s polynomial approximation about the point 
x = 0 for the function cosh x in the interval [0, 1] such that | Error | < 0.001. a 

Find the number of terms that must be retained in the Taylor’s polynomial ae about the point 
x = 0 for the function sin x cos x in the interval [0, 1] such that | Error |< _— — 

The function In (1 — x’) is approximated about x = 0 by an nth degree Taylor’s polynomial. Find n such 


that | Error |< 0.1 onO<x<0.5. | mr epolvnonial exeanas 
The function sin*x is approximated by the first two non-zero terms 1n the Taylor's polyn n 
about the point x = 0. Find c such that | Error | < 0.005, when O<x<c. | ine | 

The function tan7!x is approximated by the first two non-zero terms in the Taylor's polynomial expansion 


about the point x = 0. Find c such that | Error | < 0.005, when 0<x<c. 


Obtain the Taylor’s series expansions as given in Problems 61 to 65. 


(xIna)?— (xIna)? ‘ 











61. a* =1+xIna+—y— 7 ., eo <x < 09, 
6. infl=x)= =e 2-4... .- ee 
» In = 5 5 < 
1l+x gt _. x? 
= =—+— —] <1 
63. in = 2] 2+ 5 + r + | <x 
| - x-1 realy .afs-TP 
fed inx=al( 24) + 3(SS4) +3(254) +...| x >0 











1.4 Integration and Its Applications 


Let f(x) be defined and continuous on a closed interval 
F’(x) =f (x), a<x <b. Then, the function F (x) is call 
if F (x) is an anti-derivative of f(x), then F (x) + c, where c is a 


derivative of f (x). 


1.4.1 Indefinite Integrals 


If F(x) is an anti-derivative of f (x) on [a, 6], then for an 


indefinite integral of f(x) on [a, b] and is written as 


| fe0de- F(x) +c. 


In this case, we say that the function f (x) is integrable on [a, b). 
Integrable. For example, the function f (x) defined as | 


rexy={ 


0, xis rational 
1, xis irrational 


[a, b]. Let there exist a function F (x) such that 
-derivative of f (x). We observe that 
n arbitrary constant, is also an anti- 


y arbitrary constant c, F (x) + c is called the 


(1.39) 


We note that, not every function is 
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on [O, 1] does not have an anti-derivative and hence is not integrable. We have the following result. 
Theorem 1.8 Every function which is continuous on a closed and bounded interval is integrable. 


We can evaluate an indefinite integral directly or by using the method of substitution, or integration 
by parts etc. 


1.4.2 Definite Integrals 
Let f(x) be a continuous function on [a, b]. Let 


m= {min f(x) and M= {max f(x). 


Divide the interval [a, 6] into n subintervals [Xp. X1], [x], x2], . . ., [x,-). X,], Where xp = a, x, = b and 


A= X'Sy SZ - SM, = OF ig. 1.1). Let Ax,= x; -2x.), 621, 2, . ..., nm Let 
m = min (x) an = -o 1.9 
fa et d M, ee Lg Beus accel 
y 








Xp 1, 12 Nj-) F Xj 
SI 


Fig. 1.1. Definite integrals. 


and &, be any point in the interval [x,_;, x,]. Corresponding to this partition, define 


n 


lower sum = |, (f ) = 2 m, Ax, (1.40) 
upper sum = u,(f ) = 2 M; Ax, (1.41) 
and S,(f) = af (¢;) Ax;. (1-42) 


Using these definitions, we obtain 


If) S Sn) S Unf ). 


The sum S,(f) depends upon the way in which the interval [a, b] is sub-divided and also upon the 
choice of the points €; inside the corresponding subintervals. Let n — ee such that max (Ax;) — 0. If 


lim 1,(f) = Jim. Sx (f) = jim. u,(f) 


1.32) En gineering Mathematics 


for any choice of the sequence of subdivisions of the interval [a, b] and any &€, in the interval 
| X: 
bb Xi], 


then this limit is called the definite integral of f (x) over the interval [a, b] and is written as F(x) 
X)dy 


Remark 6 


(a) For integrability, the condition that f (x) is continuous on [a, b] can be relaxed. The 
f (x) may only be piecewise continuous on [a, b]. 

(b) The choice of points *0, Xi, - - ., X, 18 arbitrary. One may choose such that they for, ‘ 
arithmetic progression or a geometric progression. , 

(c) Let m and M be the minimum and maximum values of f (x) on [a, 5]. Then, 


functio, 


b 
m(b — a) < | f(x)dx $< M(b - a). (1.43) 


b 
(d) | f (x)dx = (b - a) f(6),a<o <b (1.44) 


(mean value theorem of integrals). 


(e) If f (x) is bounded and integrable on [a, b], then | f (x) | is also bounded and integrable on 
(a, b], and 


b b 
| f(x)dx | <| | f(x) | dx. (1.45) 








(f) The average value of an integrable function f (x) defined on [a, b] is given by 
b 
_— 
oo | F(x)dx. 
(g) Let f(x) and g(x) be integrable functions on [a, b] and let f(x) S$ g(x), a< x < b. Then, 


b b 
J f(xddes | e(x)dx. (1.46) 


if 


The method of evaluating a definite integral as a limit of sum can be used only when f(x) is a simple 
function. It may not always be possible to find the limit of sum for every integrable function f (x). We 
use the following result to evaluate definite integrals. 


Theorem 1.9 (First fundamental theorem of integrals) Let f (x) be a continuous function on a 
closed and bounded interval [a, b]. Then the function 


F(x) = [ f(tat 


Is continuous on [a, b], differentiable in (a, b) and F’(x) = f (x). 


Theorem 1.10 (Second fundamental theorem of integrals, Newton-Leibniz formula) Let 
F(x) be an anti-derivative of a continuous function Ff (x) on [a, b]. Then, 


b 
| f(x) = F(b) - F(a). (1.47) 
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they can be used to find the (i) areas of 


Definite integrals have many applications. In particular, 
iv) areas of surfaces of revolution etc. 


bounded regions, (iii) lengths of curves, (11!) volumes of solids, ( 


1.4.3 Areas of Bounded Regions 


C, The area of the region bounded by the curve y =f (x), the x-axis and the lines x = a,x = 5 is given 


by (Fig. 1.2) 


b b 
Area = | ydx= | f(x)dx. (1.48) 





Fig. 1.2. Area of region in Cj. 


We note the following: 
the value of the integral given in 


axis, then the value of the integral 
take the magnitude of this value. 


a<x<b is above the x-axis, then 
rve y=f(x),aSxSb is below the x- 
Since area is a positive quantity, we 
a<x<cand below the x-axis in the 


(i) If the curve y = OO), 
Eq. (1.48) 1s positive. If the cu 
given in Eq. ( 1.48) is negative. 

(ii) If the curve y = f (x) is above the x-axis in the interval 


interval c <x <5, then we write 
| b 
[foods 
Cc 


Cc 
Area = | f(x)dx + 
ad 
the curve x = 0(y), the y-axis and the lines y 





C, The area of the region bounded by =c,y=dis given 
by (Fig. 1.3) 


d d 
Area= | rdy= | o(y)dy. (1.49) 


C, The area of the region enclosed between the curves y = f (x), y = g(x) and the lines x= a,x =5 


is given by (Fig. 1-4) 


ab 
Area = | [ f(x) - g(x)ld, where f (x) 2g (x) in [a, b]. (1.50) 
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Fig. 1.3. Area of region in C2- 


2{?_ -— 
i] ry * ‘, 
J es NOK ON 
. ~y : 7 \ 
. ‘\ et \ 
. % : Ny % \ ‘ ’ " 
\ ‘. : : | ‘. a ‘ 
ys g\ 
I 
| : b 
dad 
0 


Fig. 1.4. Area of region in C3. 
C, If f(x) = g(x) in [a, c] and f (x) S g(x) in [c, b], a<c <b, then we write the area as (Fig. 1.5) 


c b 
area = | (s(x) - colar + | [e(x) —f(x)Jdx. (1.51) 


Area bounded by a curve represented in parametric form 
Let the curve y = f (x) be defined in parametric form as 
x= (1), y= W(@),astsb 
where (1) and w(t) are continuous functions of f in the interval [a, b]. Let xp = o(a) and x, = 9(9). 
Then, from Eq. (1.48), the area is given by 


x b 
area = [ yar= | W(t) O'(t)dt. (1.52) 
x0 a 


Functions of a Real Variable | 4% 


y 
| ye f(xy) 
KN y= yr) 
AN | | . 
NX Sy nn > — \ 
AAS ye f(x) 
y = @(x) 
| 
| 
= 4 eX 
; b 





Fig. 1.5. Area of region in C4. 


Area of a sector 
Let the curve be defined in polar form as 


r=f(0)a<s0<fP (1.53) 


where f (@) is a continuous function in |a, [ |. Let A be the area of the sector bounded by the curve 
and the radial lines 6 = @ and 0 = B (Fig. 1.6). 

In an element area, we approximate area of the sector OPQ, by the area of the triangle OPN, with 
base PN = rd6 and height ON = OP = r. (PN is perpendicular to OQ). Then 


p 
dA = srd0, and Area=A = 5 | r*do. (}.54) 
ff 





Fig. 1.6. Area of sector. 


Example 1.29 Find the area of the region enclosed between the curves y = Jx andy=x- 


Solution The curves intersect at the points where Vx =x’, or x* — x =0, that is atx = 0 and x = 1. 


Since Vx > x2 when 0 $x$ |, we obtain the area as 


1 / 
prea = [) [Ye — 2? Jae= 3 ~ 4 = square units 
0 P A » 
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Example 1.30 Find the area of the region enclosed by the curve x = a(t — sin t), Y=a (1 ~¢¢ t), 
O<t<s27n. 


Solution As ¢ varies from 0 to 27, x varies from 0 to 27a. Hence, 


2a 
Area = | [a(1 — cos t)] [a(1 — cos r)]dt 
0 


2a 2ma 1 
=a’ | (1 — 2cos t + cos*1)df = a? | f — 2cos ft + 5 (1 + cos 21) at 
0 0 


2na 


a? 2ma - i. ; 
= = = _ : 1 r 
9) I (3 — 4cost+ cos 2r)dt = 7 3 4sint+ 5 sin [ 


= 3a” square units. 


Example 1.31 Find the area of the region that lies inside the circle r = a cos @ and outside the 
cardioid r= a (1 — cos @). 


Solution The region is given in Fig. 1.7. The curves intersect at 9 = + 2/3. Let r; = a cos @ and 
r2 = a (1 - cos 6). Therefore, the required area is given by 


2 


—7/3 —m/3 


n/3 I mii 
Area = 3 | (7° -— r7)dO= =a? | [cos*@ — (1 - cos 0)” ]d@ 


ri3 
=a? | (2 cos 8 1)d8 = a*[2 sin 8 - B15” (2) ; 5] 
0 | 3 


= = [3/3 — 2] square units. 





Fig. 1.7, Example 1.31, 
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1.4.4 Arc Length of a Plane Curve 


Consider a portion of the curve y = f (x) between x = a and x = b. Then, the length of the arc of the 
curve between x = a and x = b is given by 


sf fi+(2) BY ax (1.55) 


If the curve is defined by x = @(y), c < y < d, then the length of the arc is given by 


d | bee 
ee | 14 (=) dy. (1.56) 


Arc length of a curve represented in parametric form 


Let the parametric form of the curve be given by 


x= (1), y= Wt),t9 St Sty 


where @(t) and y(t) are continuously differentiable functions on [to, t)]. If O(to) =a and o(r,) = b, then 
from Eq. (1.55), the arc length is given by 


b : 2 ; | nh | \2 2 
_ | dy = i ae dx _ , t- : [ <> 
sof (Bla f(a) ga fa) (Sle oe 


Arc length of a curve represented in polar form 





Consider the portion of the curve defined by r = f (6), a< @ < PB, where f (9) is continuously 
differentiable on [@, 8]. The curve can be represented In parametric form as 


x=rcos @0=f(@)cos 6 y=rsin 6=f(0)sin 8, as O0< 6. 


Therefore, 
dx = f’(@) cos 6 — f(@) sin 8 Be = f’(@) sin 8 + f(@) cos @ 
dO * d@ 
dx - dy : ” P 4) el . 
and e + (| a ( F'(8)|” + fF" (@). 


Using Eq. (1.57), we obtain the length of the portion of the curve between @= aand @= Bas 


B , B “ed 
s= | J £7 (8) + [f'(O)I° dd = | r? +( 45) de (1.58) 
a a | 


f(B) 2 | 
ie e= + 1 dr. (1.59) 
f(a@) 
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Example 1.32 Find the total length of the curve r = a sin?(0/3). 


Solution The curve is defined when 0 < 6 < 37. We have 


| : 5) ad = : Q 
f(@) =a sin’ (2).7@) =a sin?( 2) cos @ and f2(0) + [f(8)? = a? sin* ($) | 


Therefore, 


3 30 | @\ 10. nm = 1 
s=[ JP) + (FOR AO=a | sin?($)d0= 30 | sin“ odd 


where @ = 3¢. Integrating, we obtain 


— 3a[,_ 1an.rg| = 34% 
r=32 [1 -con2prdoe 8 [o- fin 2a], = 39. 


1.4.5 Volume of Solids 


In this section we discuss methods for finding the volume of solids. 


Method of slicing 

Let a solid be bounded by two parallel planes x = a and x = b (Fig. 1.8). Divide the interval [a, 5] 
for x into n subintervals [xo, x;], [x, X2], - - «> [%n-1, Xn], Where @ = x9 < x1 < x2... <x, =D. Let 
Ax, = X_—Xj-1, k= 1, 2, .. ., n. Draw the planes x = x9, x = x), ..., x = X,. This will cut the solid into 
slices of thickness Ax,. We now approximate the volume of the sliced solid part S, by the volume 
of a cylinder with base as a cross section of the sliced solid S, and the height as Ax,. Therefore, an 
approximation to the volume of the sliced solid between x = x,_; and x = x, is given by 


Vy = A(€,) AX p, Xp) < Cy SX, 


@, 2S se =o 





Lo 
\ 
a 
H 
= a 


Fig. 1.8. Method of Slicing, 
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where A(€,) is the cross-sectional area of the sliced solid. Now, consider the sum of all the approximate 
volumes of the sliced solids. We obtain 
n A 
in = Py ve = Pa A(Se) Ary: 
Let n — co such that max Ax; — 0. In the limit V,, > V, volume of the solid and the summation reduces 


to an integral. Therefore, volume of the solid is given by 


b 
v- | exhib (1.60) 


If the solid is bounded by the planes y = c and y = d, then volume of the solid can be written as 


d 
y= | A(y)dy 
where A(y) is the cross-sectional area. 


Example 1.33 The cross sections of a certain solid made by planes perpendicular to the x-axis are 
circles with diameters extending from the curve y = 3x” to the curve y = 16 — x’. Find the volume of 
the solid which lies between the points of intersection of these curves. 


Solution At the points of intersection of the curves, we have 3x” = 16 — x’, or x* =4, that isx=+2. 
Therefore, the points of intersection of the curves are (— 2, 12) and (2, 12) (Fig. 1.9). 

Any point on the curve y = 16 — x” is R(x, 16 — x’). 

Any point on the curve y = 3x’ is S(x, 3x’). 





Fig. 1.9. Problem 1.33. 


Diameter of the circle = RS = 16 - 4x’. 
ircle = A(x) = 4 (RS)* = 4n(4 - x2)? 
Area of the circle = A(x) = 4 (RS)* = 4n( ¥. 
Since the solid is symmetric about the y-axis, the required volume is obtained as 
2 2 ; 
V=2 | A(x)dx = sx | (4 ~x*)* dx = sn 16 _ 8 3 - =| 
0 0 | 0 


64 32] _ 2048 a 
= $132 -_> + 2 an (a 7 cubic units. 
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Volume of a solid of revolution 


Let AB be the portion of a curve y = f (x), f (x) > 0, betw 
by the arc AB of the curve y = f (x), the x-axis, and the 
revolving this area about the x-axis (Fig 1.10). 


eenx=a and fa — b. Consider the area boundeg 
lines x = @ and x = b. A solid is generated py 


4 





D 
Fig. 1.10. Solid of revolution. 


Divide the arc AB into n parts by considering the subintervals [xp, x1], [x,, X2], ~~ -s [Xp-1. Xq]; 
where a =X) <X| <X%)... <x, =5. Let Ax,=x,-—xy_), k= 1,2, ..., n. Consider a typical subinterval 
[x,_1, x] of length Ax, = MN. A solid is generated by rotating the area MNQP about the x-axis. The 
volume V, of this solid lies in magnitude between the volumes generated by revolving the rectangular 
areas MNRP and MNQS about the x-axis. Now, 


MP = yy) =f (%e1) and NQ=y,= f(x,). 


Hence, the volume V, of the typical solid is bounded as 
Tye, Ax, <S Vi Ss Ty? Ax,. 
Adding the inequalities corresponding to all the subintervals, we get 
> 4 A < a n - 
Myo Mk Ok S 2M S Vie Ate. 
Let n — © such that max Ax, — 0. In the limit, we obtain the volume of the solid of revolution as 
b 
v= | My*dx. (1.61) 
ad 


Similarly, if the area bounded by the arc AB of the curve x = (y), the y-axis, and the lines y = c and 


y = @is revolved about the y-axis, then the volume of the solid of revolution can be written as 
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mx dy. 


c 


v= f | (1.62) 


Remark 7 
the line y = p and the lines x= a, x= b is revolved 


(a) If the area bounded by the curve y = f (x), 
axis), then the volume of the solid of revolution is 


about the line y = p (a line parallel to the x- 
given by 


b 
ven (y — p)* dx. (1.63) 
a 


= q and the lines y=c, ¥ = d is revolved 


(b) If the area bounded by the curve x = g(y), the line x 
the volume of solid of revolution is given 


about the line x = (a line parallel to the y-axis), then 
by 
. | 
y= x | (x —q)° dy. (1.64) 


c 


Example 1.34 Find the volume of the solid generated by revolving the finite region bounded by the 


curves y = x’ + 1, y = 5 about the line x = 4 


Solution The required region is given in Fig. 1.11. 





y=5 
= 
oe SAAR i te, ie, x=3 
RAO, SS iia ite Eh, a 
. 7," Ny, ~* i, i+ | 
Nie ah | 


ie 
(x1, Yt) eee SPT 


Fig. 1.11. Region of revolution in Example 1.34. 


The volume is given by 


5 5 
y=n| (xf - x3 )dy = | [3+ yy-1)?-G- y—1)? |dy 
| ¥ | 


5 . 
= on | Jy - ldy= 12n( 3] [(y — 1)22]? = 82(8) = 647 cubic units. 
| 


Example 1.35 Find the volume of the solid generated by revolving the region bounded by the curves 


y= 3-2 and y =~ | about the line y = — I. 
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9. The region PAQ is revolved abou the lin 


ion is gi in Fig. 1.1 : ] 
Solution The required region is given in Fig axis, the volume is obtained as 


y =— 1. Since the region is Symmetrical about the y- 





Fig. 1.12. Example 1.35. 


V = 2 [volume of the solid obtained by revolving the region PAR about the line y = — 1] 


= 2 
=2n | (1+ y)de=2n | (1+3—x7)* ax 
0 0 


8x? rn ra 


2 ' 
=2n| (16 -— 8x2 + x4)de = 2] 16x — 80 
0 5 


Example 1.36 Find the volume of the solid generated by revolving an arch 
* = a(t—sin t), y = a(1 —cos t) and x-axis about the x-axis. 
U, and t = 27. Hence, one arch of the cycloid 


Solution * Setting y = 0, we obtain cos t = Lorr=0 
Intersects the x-axis at the points (0, 0) and (27a, 0). Therefore, the required volume is given by 


2 
| = 212 mz cubic units. 
6 15 


of the cycloid 


2a | 27 
V= | y*dx = “| a*(l — cos r)? [a(1 — cos t)|dt 
0 


: 2X F X 
— 1 6 | 1 
= Ta I 8 sin (5 Ja - ona’ | sin®T dT 


ni2 
= 32na° | sin°T dT = 32 13.3. l 2 
: ial ak ak 5 = 52*a? cubic units. 


Volume of solid of revolution by the method of cylindrical Shells 


Suppose that a region in the x-y plane 
plane bounded by the curve | 
— 1 . e i | y = q I ~ = 
_" 5 is revolved about the y-axis. Divide the interval [a, b] ioaiees Sea ae ad 
—= i ¥ — ¥ i oo» fb a | 1. OnS] er | 
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N are M(x;_1, 9) and N(x,, OJ. 
shell of inner radius 
d by the concentric 
iven 


a NOP (Fig. 1.13), where MN = Ax, and the coordinates of M, 

ea ee strip about the y-axis, it generates a hollow thin walled 

ote ae ood we and volume AV,. The base of this shell is a ring bounde 
“s inner radius x, = Pee sa | ' 

in Fig. 1.14. § x.) and outer radius x, = x4-1 + Ax,. A cross-section of this solid is g 





Fig. 1.14. Cross-section of solid of revolution. 


Fig. 1.13. Region of revolution. 


The area of this ring is given by 

AA, = IX; — THe = U(X, 5 Xp_1) (xX, — X,-1) = 2% Ey AX, 
the circle midway between the inner and outer boundaries of 
‘f we take a cylindrical shell of constant height y 


AA,y. Since f (x) ts continuous, y can take any 
1, x]. If we take y = f (Tp), 


where &, = (x, + X4-1)/2 is the radius of 
the ring and 27 ¢;, is its circumference. Now, 


standing on this base, we obtain volume as AV, = ( 
value between the minimum and maximum values of f (x) on [xy 
Xp SM S Xb then we can write approximately the volume of the shell as 


AV; = (27 E.)f (Nm) AX; Poa © 2; si 
the subintervals, we obtain 


nl. 


Adding the volumes corresponding to all 
V, = Py AV, = &. (270 4) f(M) Xe: 


Let n — ce such that max Ax, — 9. In the limit, we obtain the volume of the solid as 


b 
v= | Imax f(x)dx. (1.65) 


ra 
If the region given in Fig. 1.15 is revolved about the x- axis, the volume of the solid of revolution is 


obtained as 
(1.66) 


a 
V= | 2my g(y)dy 


c 
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Fig. 1.15. Region of revolution. 


where x = g(y) is the equation of the bounding curve AP QB. 
Example 1.37 Find the volume of the solid generated by revolving the region bounded by y= jx, 
y = 0 and x = 9 about the y-axis. 

Solution The region is plotted in Fig. 1.16. When we revolve the vertical strip of the area between 
the lines at distances x and x + Ax from the y-axis, we generate a cylindrical shell of inner circumference 
2x, inner radius x, inner height y and wall thickness Ax (Fig. 1.16(a)). We obtain the volume as 


: ° 2), 5279 _ 9722 
V= | 2mxy dx = an | xx dx = 2n( 2 [x2], = —— cubic units. 
0 0 


y y 





(a) 


(b) 
Fig. 1.16. Example 1.37, 


Alternative If we revolve the horizontal str; : 
as nia’ stp about the y-axis (Fig. 1.16(b)), we obtain the volume 


3 3 
_ 4 
#0 


where x, = 9, x, = y*. Therefore, 


3 3 
V= x | 81 dy~ | y*dy = [243 - 243 es 9727 
0 0 a cubic units. 
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Example 1.38 Find the volume of the solid generated by revolving the region bounded by the curves 
y=1+ Vx and y=1 +x about the y-axis. 
Solution The curves intersect when | + x = 1 + 4x, or when x = 0 and x = I. The points of 
intersection are (0, 1) and (1, 2). The region is plotted in Fig. 1.17. When we revolve the vertical strip 
of the area between the lines at distances x and x + Ax from the y-axis, we generate a cylindrical shell 
of inner circumterence 27x, inner radius x, inner height y* = (1 + vx )—-(1+x)= Jx —x and wall 
thickness Ax (Fig. 1.17(a)). We obtain the volume as 


1 
5/2 3 
a = 2% cubic units. 


x 


5/2 3 


1 
v= | nx yt dx=2n | x(Vx —x)dx= 22 i 
0 


0 


(0, 1) 





(a) 


Fig. 1.17. Example 1.38. 


Alternative If we revolve the horizontal strip about the y-axis (Fig. 1.17(b)), we obtain the volume 


aS 
2 


2 
ven dyn] x5 dy 
l 1 


where x, = y — 1 and x2 = - 1)’. Therefore, 
2 
(gad? O-De _ 11m 
= = 113 —5|= 75 cubic units. 


2 
ven[ (y-b?-O- Dilan : 
l 


] 


1.4.6 Surface Area of a Solid of Revolution 


Let y =f (x), f (x) 2 0 between x = a and x = b define a curve. Let this curve be revolved about the 
x-axis to generate a surface S (Fig. 1.18). Divide the interval [a, b] into n subintervals [Xo, +1], 
[xy Rebs s « vx igpete Sel where a =X <X1 < X72... <x, = b. Let Axy =X — Xe and Ay; = ye- Veet 
= f (x,) —f (4-1), ¥= 1,2, ...,n. Consider the portion of the curve PQ in the interval [xj-1, %«]- Let 5x 
be the area of the surface generated by revolving this portion of curve about the y-axis. In this interval 
[xp-1. X;], We approximate arc (PQ) = chord (PQ). If we revolve the chord PQ about the x-axis, we 
obtain a frustum of a cone (Fig. 1.19). Now, the area of the surface S, is approximated by the area 


of the surface of the frustum of the cone. We have 


PM = yp.ON = Yo PQ == J (Ax,)*+ (Ay,)? 
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Fig. 1.19. Surface of revolution, 


Fig. 1.18. Surface of revolution. 


—_— r 
and Se = 1 (yp, typl = Mer + Yd) V(Axn)° + (Ave) 


Ay ‘ 
k 
= Uy + Ye) 1+ (Be) Axy 


Adding the approximations corresponding to each of the subintervals [x,_;, x,],k = 1, 2,...,n, we 


obtain 

fn fl A 

= 2S - = Emons tye) fie (Be) AXx,. 
k=l k=l k 


Let n — co such that max Ax, > 0. In the limit, we obtain the surface area of the solid of 


revolution as | 
= 2my ,j1+ ae dx = 2m y ds (1.67) 
Ji x , 


where ds = 4/1 + (dy/dx)* dr. 
If the given region is revolved about the y- 





axis, then we obtain the Surface area as 


d 2 
=| 2x 1 ax d ° 
f | dy y= ) 2x ds (1.68) 
where ds = y/1 + (dx/dy)? dy. 


If the curve js given in parametric form aS X= P(t), y = VW), t<t<t then we have 
] —_ — Ff]; 


dx ay\2 
ds = [ey (3 dt. (1.69) 


Functions of a Beal Variatle | 4) 


If the curve is given in polar form r= { (9), ,< O< G;, then we have 


ay \? 
a Apt ia  Ee | 
ds = y + 7a | dG (}. 79) 
Example 1.39 Find the surface area of the solid generated by revolving the circle x“ + (y by =a’ 


b 2 a about the x-axis. 

Solution The equation of the circle can be written in parametric form as 
x=acost,y=bsasint,Ostt27 

We obtain 


a ae 2 
as 1) «| 2) = /(-asint)’ 4 (acnt) =a 
dt \\ dt) dt} * 
Therefore, 


27 
S- | 2m(b+asintjadt = 2 nal bt _ a cos t\2" = 4 xab square units 
0) 


Example 1.40 The part of the lemniscate P =2a* cos 20,0< O< 1/4, is revolved about the x-axis 
Find the surface area of the solid generated. 


Solution We have x = rcos 6, and y = sin 6. We find that 


| \" 4 int DOF ‘4 ; 4 
ds* =r" (5) =r? + So sin 28 _ 5. [4a*cos? 26 + 4a* sin* 26) = o.. 
mia emis / ) 4 
Therefore, s= | 2m y dg = | Inrsin@| —— \dé 
0 f) _. 


, mia oh . |= 9: Wy LF 
= 4na7|-cos 8] = 41a I oF 2m a°(2 — ~2) square units. 


Example 1.41 The line segment x = sin*t, y = cos“t, 0 <t < 77/2 is revolved about the y-axis. Find 


the surface area of the solid generated. 
Solution The surface area is given by 


SS TT 


| . | ( dx\" 
s= | ie wt) dy. 


r 


We have 
| . d . dx 
GX <2 sint cost, = = ~ 2acostsint and ae it, 


As t varies from 0 to 1/2, y varies from | to 0. Therefore, 
| air ; 
S§= { aJInx dy = - | 2-42 sin? (--2 sint cos t)dt 

0 


fj 
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zf2 r ——— = 
-_ ‘ Heli cnt) = 22 equate vans 
= 43 2 | sin“rcostdr= 42% )/7 S18 Ll — 


Exercise 1.3 
5 = o 7 :; * - et . 2 ear al 
In problems 1 to 9. find the area of the region bounded Dy tae grvem Cie” 


l. y= 


= 
/- 
-_ 


x — Sx + 6. the x-auis and the mes x = 0. 2 = 


Pr -_= ~=—- 741 mee yeas} 
2 y=x, y= ¥x and the ines x =0.2=! 3. y =2 am) = 4 
“ ? a. _— —_ - 
a x S wyx+47 = anc tie CoUPOiidit 2a 


4. 


2 2 ; 
— iy — 


a” b* D 





6 y= ex In x and y = In x/(ex) 


7. x= 241, 7 =4¢-1.-1/2 £: < 1/2 and the x-as. 


& x=acost, y=bsim1.0<: 
10. Find the area of the region enclosed between the curve » =-2—r. the 


ioe ~*~ Fh 0<6= 22 
-com 29).92°92 22 


peas and the orden: oS tie 


-_ 


— 
— 


points where the curve has local mummum 


11. Find the area of a loop of the curve x00 +) = alr - yr) 
. rerae f= € 


12. Find the area of the region inside the curve 7 = Za cos 26 anc oulsiae © 
13. Find the area that is inside the circle , = a and outside the cardiac r= 2 - 


-——<— 


- 
—-— fF Te. eT 
oe ae = 


In problems 14 to 26, find the Jength of the indicated pornon of tine curve 


14. 9x? =y, from x=Otox=9. 
15. x77 + y** =a”, from x = 0 to x =a in the first quadrant 


16. x=4tyt41,. from y= lwo y=2. 


17. x° + y’ — 2ax = 0 and above the line y = a/2.a > 0. 
18. yal: Vcost dt, from x=0 tox = 2/2. 


4 8 


19. y = In [(e* + 1 yWle* — 1)). from = 


20. x = 3ar’, y = alt - 39), from 1=Otor= ]. 

21. x =a(t—sin 1), y= a(l—cos!), fromit=Qto1r=2z 

22. x=" cost, y=e” sins, fromi=Ow1= I. 

23, x = (In (a’ + P)Y2, y = tan” (t/a), fromt=Owr1=a 

24. x = 2c0os t+ cos 26+), y=2 sins + sin 2¢, fromr=Otwr-7 


25., r= a6, from r=r, tor=ry. 
26. r=ae™, from r=r, tor = rp 


2 


y 


2 2 
27. Find the volume of the ellipsoid a3 ~ re: ~ = ie 1. 
28. The base of a certain solid is the circle x7 + y? = a*. Each cross-section of the solid cx og by 2 Dae 


perpendicular to the X-akiS 18 a Square with one side of the Square in the base of the solid Fmd 
volume of the solid. 


29. The base of a certain solid is the circle x* + y* = a*. Each cross-section of the solid cat out by a pame 


perpendicular to the x-axis is an isosceles right triangle with one of the eine cides in the bast of OF 
solid. Find its volume. SO 
7 xX => 0 ra 


WW. The base of a certain solid is the region between the %-axis and the curve y = cos x between x= 
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x = 7/2. Each cross-section of the solid cut out by a plane perpendicular to the x-axis is an equilateral} 
triangle with one side in the plane of the solid. Find its volume. 


In problems 31 to 36, find the volume of the solid of revolution generated by revolving the specified region about 
the given axis. | 


31. 
32. 


33. 
34. 
35. 
. Region bounded by x = 24 + 1, y = 427 - 1, -1/2 <1 < 0, y = 0 about the line x = 1. 


36 


Region bounded by y = cos x, y= 0 from x = 0 to x = #/2 about the x-axis. 
Region bounded by y = Jx, y = 0 from x = 0 to x = 4 about the x-axis. 
Region bounded by y= 4x, y = 0 from x = 0 to x = 4 about the line y = 2. 
Region bounded by y = x’ + 1 and y = 3 — x about the x-axis. 


Region bounded by x = a sin’ t, y=a cos’? 1,0<1< 2/2,x=0, y = 0 about the x-axis. 


In problems 37 to 41, use the method of cylindrical shells to find the volume of the solid generated by revolving 
the specified region about the given axis. 


37. 
38. 
39. 
40. 
41. 


Region bounded by y = x, y = 2 and x = 0 about the y-axis. 

Region bounded by y = 2x — x’ and y = x about the y-axis. 

Region bounded by y = x’ and y = x about the y-axis. 

Region inside the triangle with vertices at (0, 0), (a, 0) and (0, b) about the y-axis. 
Region inside the circle x* + y’ = a’ about the line y= b, b>a>0. 


In problems 42 to 50, find the surface area of the solid generated by revolving the curve C about the given line. 


2 


“ 


2 1 
42. (x —b)* + y? =a’, b> a about the y-axis. 43. %-+2-=- 1,a2b, y2 0 about the x-axis. 


44, 


al 


a b 


| 
| 


2 : 4 . 
x” +> =1,a>5b, x >0 about the y-axis. 45. yet >» 1 <x <2 about the line y=— 1. 


oo 


x 


a ie eT < 2 about the line x = -1. 
46. 292+ qt =? about the line x 


47. x=a(t—sin?t), y=a(l-cosft),0<rs 22 about the x-axis. 


48. x=acos’t, y=a sin’ t, 0 <1< 2/2 about the x-axis. 


49. x=e' cost, y=e' sint, 0<t< 2/2 about the y-axis. 


50. r=a(1+cos 6), 0 < @< about the initial line. 


1.5 


Improper Integrals 


b 


While defining the definite integral | f(x)dx, we had assumed that 


(i) a and 5b are finite constants. 


(ii) f (x) is bounded for all x in [a, 5]. 


If 


infinite at x = a or x = b or at one or more points within the interval (a, b), then the de 


in the above integral, (i) a or 5 or both a and b are infinite, or (11) a, b are finite but f (4) becomes 
finite integral 


is respectively called 


(i) improper integral of the first kind. 


(ii) improper integral of the second kind. 
To define the improper integrals, we assume the following: 
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(i) The integrand f (x) is of the same sign within its range of integration. Without any loss of 
generality, we assume that f (x) > 0 (when f (x) < 0, we can write g(x) = — f (x) so th 
8 (x) 2 0). We shall discuss later, the case when f(x) changes sign within its range of integration 


(1) f (x) 18 continuous over each finite subinterval [a, 6] contained in the range of INte gration 
Hence, there exists a positive constant K independent of a and f such that 


B 
| f(x)dx<K, 
(t 
The improper integrals are evaluated by a limiting process. 


1.5.1 Improper Integrals of the First Kind (Range of Integration is Infinite) 


We shall now discuss methods to evaluate improper integrals of the form 


oo b oo 
(1) | f(x)dx, (ii) | f(x)dx, and (iii) | f(x)dx 
if they exist. We define these improper integrals as follows: 


o2 p 
(i) f(x)de= lim | f (x)dx. (1.71) 


If the limit exists and is finite, say equal to l,, then the improper integral converges and has the 
value /;. Otherwise, the improper integral diverges. 


b b 
(ii) f(x)dx = lim | f(x)de. (1.72) 
p 


= oo 


If the limit exists and is finite, say equal to l,, then the improper integral converges and has the 
value /,. Otherwise, the improper integral diverges. 


eo c b 
(iii) [ _ Fladar = lim, I P(x)de + lim | f(x)dx (1.73) 


where c is any finite constant including zero. If both the limits on the right hand side exist separately 
and are finite, say equal to l; and /, respectively, then the improper integral converges and has the 
value /; + /4. If one or both the limits do not exist or are infinite, then the improper integral diverges. 
Example 1.42 Evaluate the following improper integrals, if they exist. 

= dx 


(i) | ee (ii) [ (iii) . x 
0 a* +x? ] x (E i | es ax, 





(iv) | x sin x dx, (v) | e-“cos px dx, a > 0, P constant 
0 I | 


Solution 


(i) [ +45 = Jim ° dx =< 1G L cand |b 1 
0 atx? bom Jy gr? oy? oe |g Glas 


Therefore, the improper integral converges to 7/(2a). 
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: = | a dx 


c O64 go =] 


b 
_, 
he ref feel ames 
= lim [sec™! nen —_ b — sec"! c] 


_ “i 1 _ . 
l ¢ — sec”! l + > — sec lon dt 


2 
Therefore, the improper integral converges to 7/2. 


= SE€Cc 


})—} 00 


b 
(iil) { e*dx = | « ar 2 jim | e~*dx = lim (1 -e7’) = 1. 
0 bc 
Therefore, the improper integral converges to |. 
oo b 
(iv) | xsinx dx = lim | x sinx dx = lim (sinb — bcos b). 
0 Ta AiO a 
Since this limit does not exist, the improper integral diverges. 


(v) Using the result 


| e~ “cos px dx = ———_; (p sin px — a cos px), 
a“ +p- 


we obtain 
b 


b — (it 
e~**cos px dx = —___ (p sin px — a cos P| 
a~ + p* 


0 0 


= —— fe" \(p sin bp — a cos bp) + a] 
a 43 -ab _¢ 
Now, sin bp and cos bp have finite values and tim, e~* = (0). Hence, 
eo b . 
‘on = lim e“cospr ik = 
j e~™* cos px dx jim I p San 
Bie: 2 
Therefore, the improper integral converges to a/(a° + p’), 


Example 1.43 Discuss the convergence of the improper integral 
| 2 
) x? 


Solution We have 


Now, lim [be | : QO. 
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integral converges if p > 1 and diverges if p< 1. 


Therefore, the improper 


For p = 1, we have 


ea b 
ax = lim | ax lim [In x]? = lim In b. 


Since the limit does not exist, the improper integral diverges. Hence, the given improper integra) 


oo 


converges to I/(p — 1) for p > 1 and diverges for p < 1. 
Example 1.44 Discuss the convergence of the integral | xen* dx. 


Solution We write 
oo , c 4 said 2 

=| xe? d= | 4o°* ax+ | xe ade 
— oo — Cc 


where c is any finite constant. We have 


c b 
I= lim | xe7™ dx + im | xe~* dx 
b— co ‘ 


d——o 
a 


= lim 
a——ee 


E (e7® — ee | + jim E (e-" =e 


eer 4 e- ) =O, 


-l 
2 
Therefore, the given improper integral converges to 0. 

It is not always possible to Study the convergence/divergence of an improper integral by evaluating 
it as was done in the previous examples. A sj | I © g-? 

pies. A simple example is the integral e~* dx which cannot 

i - 0 
some results which can be used to discuss the convergence or 
Se, we cannot find the value of the improper integral, that 


be evaluated directly. We now present 
ef, we may be able to find a bound of the integral. 


divergence of improper integrals. In this ca 
is the value to which it converges. Howev 


Theorem 1.11 ( Comparison Test 1) If 0 < Ff (x) € g(x) for all x. then 


sa] 


(1) | J (x)dx converges if | 
(11) / &(x)dx diverges if | f(x)dx diverges. 
Theorem 1.12 (Comparison Test 2) Suppose that f(x) and g(x) are Positive functions and let 


f(x }_ 7 ¢ 
Folle — (1.74) 


8(x)dx converges. 





lim 


X—> 09 
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Then, the improper integrals | f(x)dx and | 8(x)dx converge or diverge together. 


a 


Example 1.45 Discuss the convergence of the following improper integrals 





| = = dx p= 
(i) I en” dx. (ii | > iii ax 
3 (11) eae (111) ; nx’ 
(iv) | . ae (v) © XtanTtx 
7) x(in x)? dias + x3 


Solution 


= 


‘ ee = ' 
(1) We have e-*" < e™ forall x> 1. Consider the improper integral | e* de: 


(11) 


(111) 


l 


— = b 
We have | e“*dx = lim | e“*de = Jim [1 - e-] =1. 


—) 


Therefore, the integral | e~~ dx is convergent. By Comparison Test 1 (i). the given integral 


is also convergent. Further, its value is less than 1. 


) ] | ] 
Let f(x) = ————._ and re 
F(a) (e * + 1)x? ame ake) x? 





Now lim Fal = lim ——+___ =| = lim = 1 
x40 g(x) | ios (e-* a 1)x ] Xe eT * 4 | 


Also, [ 2(x)dx = | 3 —z converges to | (see Example 1.43). Therefore, by Comparison 


Test 2, the given improper integral is also convergent. Its value is less than 1. 


Alternative We have —— < + for all x = 1. The improper integral | J is 
(e-* + 1)x x x2 


, ; l 
convergent. Therefore, by Comparison Test | (i), the given improper integral converges. 


We have In x < x for all x > 0. Hence, 


ajuda a> | dx 
Inx <x 5 Inx 3 2 


Let g(x) = 1/(In x) and f (x) = 1/x. We have g(x) > f (x). Now, the integral 


| f(x)d& = | a is divergent (see Example 1.43). 
2 2 


oo oc ax ; | | 
Therefore, by Comparison Test | (ii), the integral | e(x)dx = | ae also divergent. 
2 2 
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Qv) Substitute In ye 7. We pet 


l= [ a [. dt 
» wV(Inw)? ing oe? 


Which is Convergent tor P> | and divergent for ps | (see Mxample 1.43), 


- | antl 
iW) Let f(x) = Xan - 1a. and g(x) © be. 
v4 bx" Vx VI hax Vx 


5 


We find that lim Lie) lim —pilendeer = 2, 
ror BON) vdeo Vi¢e4x-3 2 


= 


Hence, by Comparison Test 2, the integrals | f(x)dx and | R(x )dx CONVETBE OF diverge 
| 


together. Now, | 


&(x)dx is divergent. Therefore, | f(x)dx is also divergent. 


1.5.2 Improper Integral of the Second Kind 


b 
Now consider an improper integral of the form | f(x)dx, where a, b are finite constants, f (x) is 


continuous in (a, 5) and has infinite discontinuity (becomes infinite) at (i) x = a, or (li) x = b, or 
(iil) x= a and x= b. or (iv) f(x) is continuous in (a, b) except atx=c,a<ce< b, where f(x) has an 
infinite discontinuity. 

If f (x) has a finite number of points of discontinuity, Oly CQ, ss ley ASC) Seg... <0, $b, 
then we write the integral as 


[ f(x)dx = [ f(x)dx + [ Sed tees f f(x)dx (1.75) 
a a ¢ a 
and consider each integral on the right hand side ‘eandely 
Infinite discontinuity at x=a Since the function f (x) is continuous at all points except at x = 4, 
the integral f(x)dx is a proper integral and exists for every €,0<ée€<hb—a. 


ate 
We evaluate the improper integral as 


b b 
f(x)dx = lim | (x)dx 
J ane ate d , 
If this limit exists and is finite, say equal to /;, then the improper integral converges to /,. Otherwise, 
it diverges. 


Infinite discontinuity at x = b Since the function f(x) is continuous at all points except at x = b, the 
b-€ 
integral f(x)dx is a proper integral and exists for every €,0<e<h-— a. 


if 
We evaluate the improper integral as 


b b-e 
| f(x)dx = lim | f(x)dx. 
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Infinite discontinuity at x = a and x = h We write the improper integral as 


by 


b (x 
| f(xrde = | f(x)dx+ | f(x)de 


where @ 1s any finite constant between a and b at which f is defined. We evaluate the improper 
integral as - 


Ct b-—€ 


b 
| f(x)ax= lim f(x)dx + lim F(x)dx. 
a ot 60 Jy 


d+eé 
If both the limits exist and are finite, then the improper integral converges. Otherwise, it diverges. 


Infinite discontinuity at x = c, a <c<b We write the improper integral as 


b c b c-e b 
| f(x)dx = | f(x)dx+— fix)dx = him | fx)dx + tim | f(x)dx. 
a a *C = a i o+e 


The given improper integral converges, if both the integrals on the right hand side converge. If one 
or both the integrals on the right hand side diverge, then the given improper integral diverges. 


| The following tests can be used to discuss the convergence or divergence of the above improper 
integrals. In this case, we cannot find the value of the improper integral, that is the value to which it 
converges. However, we may be able to find a bound of the integral. 


Theorem 1.13 (Comparison Test 3) If 0 < f(x) < g(x) for all x in [a, b], then 


b b 
(i) | f(x)dx converges it | g(x)dx converges. 
(l 


a 


b b 
(ii) | g(x)dx diverges if | f (x) dx diverges. 
a ra 


Theorem 1.14 (Comparison Test 4) If f (x) and g(x) are two positive functions and 
(i) a is a point of infinite discontinuity such that 


fing 2S! = pee ee 


= =1,,0<1, < © 
a ge) Cee etat+hy) eS 


or (ii) b is a point of infinite discontinuity such that 


_ f(x)_,. f(b—-h) 
Aes g(x) a g(b —h) 





=14,,0<l, < 00 


b b 
then, the improper integrals | f(x)dx and | g(x)dx converge or diverge together. 
a 


a 


Example 1.46 Evaluate the following improper integrals, if they exist: 


4 2 
(i) | = (i) | ah 
0 Vx 0 V¥4—x? 
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1 ~ 3 
i ]+zx dx 
il dx (iv — 9 
ay) f [-x i) 3x -—x* 
{v) : ax (vi dx 
SS V1 So gee eee 
-| -" 6 x? — 3x+2 


Solution 


0 7h) 4 ma NEI=4 


Therefore, the improper integral converges to 4. 


2 2-€ 
a dx dx ; si = — 
(41) | , = jim ——— = lim sin { 3) =sn*] = 
0 J 4 x2 E—) 5 l4 _ x? E—rf) 2 
Therefore, the improper integral converges to 77/2. 


’ ties mies edgy fe ae 
(iy —— — ' j ! —_ \ ! . a dni j | 
me i; Leo I Vi-; "2 [. i 21, For 


-l 


= lim [{sin-'(1 - €) — sin~!(_1)} — {(Vl-(l-e)? - VT— 1}] 


= sin” (1) — sin“(_]) = 9 sin (l)=7 





NIA 











Therefore, the improper integral con Verges to 77. 


(1v) Here, the integrand f (x) has infinite discontinuity, 
take any point, Say x = c, inside the interval of inte 





at both the end points x = 0 and x = 3. We 
gration, at which f (x) is defined. We write 








[ dx -[ dx ; , ods , © dx 3 dy 
Jo 3x — x? Fi) 3x — x? ena = Him | ee + bi } x(3-—x) 





- 1; —_)\f 1, e Yr 
s4|'(s3)] +5 yn[in( 522) 


€ 





oe or = E . _¢ ge 
= 5 im | 3-¢ (3a) | Som [in( 258) =] 


We write 7 | of integration 
i 0 | = 
= = dx dx ~ lim . dx . I dx 
~{ * , x? 2 90) xe * pm é x2 
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Therefore, the improper integral diverges. 


(vi) The integrand has infinite discontinuities at x = | and x = 2, both of which lie inside the 
interval of integration. We write 


i dx 7 dx : dx +f dx 
, y= tre) és (x-1Iyx-2)- (x — 1)(x -2) ‘ (x — 1)(x - 2) 


= I + I, ~~ I. 
We find that 
(a) the integrand in /, has infinite discontinuity at x = 1, 
(b) the integrand f (x) in /, has infinite discontinuity at both the end points x = 1 and x = 2. We 
take any point, say x = c inside the limits of integration, at which f (x) is defined. We also find 
that f (x) < 0 when 1 <x <2. We write g(x) = ~ f (x) so that g(x) >O when l<x< 2. Therefore, 


we can write 
ae ; dx | te dx 
ee / G@-—-De-x) J, @-DC-2) 


(c) the integrand in J; has infinite discontinuity at x = 2. 


Hence, we can write 





: dx | in. dx . dx 
2 = jim (x— 1x -2) ua (x -1)(2-2x) 
9 x= Se42 4M do x-—1f(x—-24) & 1463 
- ie dx , 2 dx 
= om 3 (z—1)(2—x) * 4-20 _ (x — 1)(x - 2) 


| 7 
_t €, +1) ; _ 4; : fe} ( E> | 
= lim, in (<L+" : —In 2 jim, in| 7 4 In | 2 i 


' : b= Ey el! : I AE ( Es ] 
“anfe(252)—»(522) aml) -m( 


= 

















Since the limits do not exist, the improper integral diverges. 
Note that the improper integral /; diverges. We could have concluded that the improper 
integral diverges without discussing the convergence/divergence of /2 and I. 


b 
dx 
Example 1.47 Discuss the convergence of the improper integra! | fea p> 0. 
Solution The integrand has infinite discontinuity at x = a. We write 
y de | l 


b 
« tt- a)? eW Jase (x-a)? 1 -p £0) (b- a)? er" 


_ fit -py(b-a)?"], ifp<! 
7 | O°, ifp> |. 
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For p = 1, we get 











b | b | r By 
ax = lim dx _ jim in|? a) =e. 
gre ee) x-8 E—0 


Therefore, the improper integral converges for p < 1 and diverges for p 2 | 


n/2 
Example 1.48 Show that the improper integral | tan x dx is divergent. 


-7/2 


Solution The integrand has infinite discontinuity at x = + 7/2. We write 


ai2 
| tan x dx = lim m | 


¢ —1/2 


(2/2)—€ 
tanx dx + im | tan x dx 
é0 


(m/2)+€ c 


(2/2)-€ 
= lim [-In ( cos ¥) | erase + eer [-In (cos x), 


—7 In cos - - + e) ~ In [cos 3) 
7 lim i co (+ - ) — In |cos co} 


Since the limits do not exist, the improper integral diverges. 


Note that if we write 


ml2 (1/2)-E 
tan x dx = lim tan x dx 


-n/2 £0 J_(n/2)+¢ 


m/2 
we get | tan x dx = 0, which is not the correct solution. 
—ml2 


Example 1.49 Discuss the convergence of the following improper integrals 
2 Vx n/2 
. x 
(i) | x~ dx. (ii) [- ane 
Solution 


(i) We have f(x) = (¥x/In x) > 0, 1<x<2. The pointx= 1 isthe only point of infinite discontinuity: 
Let g(x) = I/(x In x). Then, we have 


f(x) fl+h)_,, ich 
Bae g(x) = g(1 +h) = jn E (1 + q (1 +h) In (1 + A)] 





ios \V2 
= lim (1 + h)"* = 1. 
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Therefore, both the integrals [ f(x)dx and [ g (x)dx converge OF diverge together. 
: 








| : dx | : dx = 5 
‘ | = = lim =| In l as. 
Now, | gixidx= | lox lim _ vie lim (In (Inx))y,, 


= lim [In (In 2) —- In(In(1 + €))J 9 ~. 


i—rJ 


Since le ( x )dx is divergent, the given integral [9 x)dx isalsodivergent byComparison Test 4. 
| ] 


i ape f 
x | . ' | 
(ii) Wehave f(x)= ee = —— a2 gt. since sin x/x is bounded and (sin x/x) < l, 
AY ST * Vx J x 





O<x< n/2. Let g(x) = Ux. We have f(x) < g(x), 0<x< 2/2. 
Now, g(x) has a pomt of discontinuity at x = 0. Hence, 


arz mf2 dx Fe 
| g (x)dx= | = = iim | — = lim [| /2a - 2Ve] = 2. 
Vx e e—) 


gI2 xi2 
Since | g{x)dx is convergent, the improper integral | f(x)dx is also convergent by 
6 0 
Comparison Test 3 (i). 
xi2 . 
cos” x 
0 





Example 1.50 Show that the improper integral dx converges when n < 1. 


Solution We have f(x) = —= ate +, 0 <x < 7/2. The point x = 0 is the point of infinite 
x x 

discontinuity of f(x). Let g(x) = 1/x". Then f(x) < g(x). 
exi2 | af2 dx 

Since the integral [ g(xj)dx= { 7-7 is convergent for n < | (see Example 1.47), the given 
9 r 

integral is also convergent for n < 1 by Comparison Test 3(i). 

1.5.3 Absolute Convergence of Improper Integrals 


In the previous sections, we had assumed that f (x) is of the same sign throughout the interval of 
integration. Now, assume that f (x) changes sign within the interval of integration. In this case, we 
consider absloute convergence of the improper integral. 


b 
Absolute convergence The improper integral | f (x)dx is said to be absolutely convergent-if 


eb 
| | f (x) | dx is convergent. 
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b 
Theorem 1.15 An absolutely convergent improper integral is convergent, that is if | f (x) | dx 


a 


b 
converges, then | f(x)dx converges. 
ra 


Since, | f | is always positive within the interval of integration, all the comparison tests can be used 
to discuss the absolute convergence of the given improper integral. 


" sin (I/x) : absolutely for 
Example 1.51 Show that the improper integral | —; 4x converges EY SOLD < I, 


0 xX 

Solution The integrand changes sign within the interval of integration. Ne we consider the 
absolute convergence of the given integral. The function f (x) = sin (1/x)/x? has a point of infinite 
discontinuity at x = 0. We have 


2% 


xP 


< 


lf(x)|= 





sin (1/ x) 
xP 





I 
Since { dx converges for p < 1, the given improper integral converges absolutely for p < |. 
Oo x 


Example 1.52 Show that the improper integral | ~Sin x dx converges. 
ii RE 


Solution The integrand f(x) changes sign within the interval of integration. Hence, we consider the 
absolute convergence of the given integral. We have 















































in. - 
II | = | sinx gy < f -sinx | 4, 
c a b 
= lim | nx | dx + lim Sa i 
Now, 
“ sin x 
/, = lim | at dx < lim l 
: = = = —| ide 
Sa a 1+x? a——co 3 1 + x2 jim [tan Cc — tan a] = tan ete, 





an b 
Ia = jim | | ox Idx < lim a | “ 
pe Je | 1 + x? pe Jo 1+ x2 = pm [tan 6 — tan ‘c| ~ 





5 —tan lec. 
Hence, |I|<l+h<x Therefore, the given improper integral converges 


1.5.4 Beta and Gamma Functions 


Beta and Gamma functions are improper integrals which are 


names a: commonly encoun ; — 
and engineering applications, These functions are used in e : tered in many scienc 


valuating many definite integrals. 
Gamma function 


Consider the improper integral [(a) = | x*le-Xdx, a>. (1.76) 
, 16, 
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oo 


x%1e* dx + | xe Fdx= I) +1p,0<c<@. 


c 


c 


We write the integral as J[(a@) = | 
0 


rvs rn J, is an improper integral of the second kind as the integrand has a point of discontinuity 
om j whenever 0 < a< 1. For a2 1, it is a proper integral. The integral /; is an improper integral 
of the first kind as its upper limit is infinite. We consider the two integrals separately. 


Convergence at x = 0, 0 < a < 1, of the first integral /, 


ii .. ee? 
= lim ——<—=1 





In the integral /,, let f (x) = x%-le* and g(x) = x*!. Now, lim 
x0t B(x x30 Xx 





c Cc 
| dx 
Since | g(x)dx= | na converges when 1 — @ < 1, or @ > O, the improper integral /, is 
0 


convergent for all a > O. 


Convergence at ©, of the second integral /, 
Without loss of generality, let c > 1. Otherwise, the integral can be written as the sum of two integrals 
with the intervals (c, 1), (1, ©). The first integral is a proper integral. 

Let n be a positive integer such that n > a— 1, a> 0. Then, 


a—-l<n, x*'!<x" and xf le * 2 z"e".. 1 x eee. 


Therefore, | x° 9" * dex | 


c c 


oo 


»b 
x*e* dx = lim | xe" ax 
b— poo 
eG qb 
= lim le { polynomial of degree n in x, F (x)}]_ 


= lim [e~® P,(b) — e~* Py (c)| = — e* Pn (0) 
b— oo 


since lim [b*/e] = 0 for fixed k. 
The limit exists and the integral / 
Hence the given improper integral 

called the Gamma function and is denoted by I'(@). 


T(a)= | x*'e*dx,a>0. (1.77) 
0 


converges for a > 0. 
(Eq. (1.76)) converges when & > 0. This improper integral is 


Therefore, 


Some identities of Gamma functions 
1 rd= | etdx = 1. 
0 


2. T(a+ 1) = al (@). 
(1.76) by parts, we get 


(1.78) 


(1.79) 


Integrating Eq. 


r(at+ l= | x%e *dx=- jeter i ¥ a| x! e-* dx = al (a). 
0 | 0 


3. Pim + 1) = m!, for any positive integer m. 
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=m(m—I1)..-. = m! 
sve have Fem + 1) = EC) = mm — DT (m= 1) = =m ) 
e ha | im 
4. ri/2)= V7: 
We have 


= pote 1qx=2| on" du. (setx = 4) 
T (1/2) J xe , 
We write 
| 2 os oy = fe ee 
(3) = 2 | en | E | e7! | —-4 ) I é 
0 0 
lv = r dr dO and 
Changing to polar coordinates u = r cos 6, v =r sin 0, we obtain dudv =r ar n 
oo oo 2 a 
r é =4 {" | re’ dr d@ = 2n | re’ dr= ale” Jo =7%- 
- r=0 0 


@=0 
(1/2) = vz. 


(In Chapter 2, we shall discuss evaluation of double integrals and change of variables.) 
(1.82) 


Hence, 


5. T(-1/2)=—-2V a. 
We have ['(a) = [I (a + 1)]/a. Substituting a = -1/2, we get 


r 5) = cay 


~ 2} (-1/2) ~ 


Beta function 
Consider the improper integral 


i= | x™1(1 —x)"!dx,0<m<1,0<n< 1. 
0 
Note that J is a proper integral for m 2 1 and n 2 1. The improper integral has points of infinite 


discontinuity at (i) x = 0, when m < 1 and (ii) x = 1, when n < 1. When m < 1 and n < 1, we take any 
number, say c between 0 and | and write the improper integral as 


c ] 
[= [ x™!1 (1 — x)" dx+ | x” (1 —x)""! dr = I, +1, 
, ) : 


c 


(1.83) 


c 
1 
i= m=-1¢] _ »\n-l | gm ‘as 
where 1 ) xe" (L-x)""dx and I, | x™" (1 — x)! dy. 


c 


q is an improper integral, since x = 0 is a point of infinite discontinuity, while J, is an improper 
integral, since x = | is a point of infinite discontinuity. We consider these two sitegrils separately 


Convergence at x = 0, 0 < m< 1, of the integral /, 


In the integral J), let f (x) = x”"'(1 — xy"! and g(x) = "1. 
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Now, lim f(x) _ lin xm" -x)"t a 
x30t 2(X) — x-40+ ge 
‘ie cd 
and | g(x)dx = | — is convergent only when 1 -m<1,or m>0O. 
0 0 x 


Therefore, the improper integral /, converges when m > 0. 


Convergence at x = 1, 0 <n <1, of the integral /, 
In the integral /5, let f (x) = x—'(1 — x)""! and eG) = (1x). 


Now, lim f(x) = lim xm =x)" 1 
x3i- §(%) xe (1 - a 





1 I 
and g(x)dx = | _ ax converges when 1|—n<l,orn>0O. 
- (Lean) 


c 


Therefore, the improper integral J, converges when n > 0. Combining the two results, we deduce that 
the given improper integral (Eg. (1.83)) converges when m > 0 and n > O. This improper integral is 
called the Beta function and is denoted by B(m, n). Therefore, 


l 


B(m, n) = | x™1(] —x)""dx, m>0,n>0. (1.84) 
J0 


Some identities of Beta functions 


1. B(m, n) = B(n, m) (1.85) 
(substitute x = 1 — ¢ in Eq. (1.84) and simplify). 


mid i 2 
2. B(m,n)=2 | sin*”—! (@) cos*""! (9) d@ = 2 | sin*""! (8) cos?”"! (8) dé. (1.86) 
0 0 
(substitute x = sin? @ in Eq. (1.84) and simplify). 
3. B(m,n) [ ed ‘ 
. . = ee ee : 
men |. Came (1.87) 


(substitute x = t/(1 + #) in Eq. (1.84) and simplify). 


(mm) P(r 
4. B(m,n) = (1.88) 


We can prove this result using double integrals and change of variables. We have 


(mm) = | fet den | y2m-l p-u? du, (set x = u’) 
0 0 


og 


T(n) -| xMle-x dx=2 | p2n-l p-v? dv, (set x = v2) 
y() 0 
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T(m) (nn) = 4 | | y2mnl py 2n-l p-(u? +0" du dv. 
Changing to polar coordinates, u = r cos 6, v = r sin 8, we get 


Tt pe — ee 
C(m)T(n) = 4 | | cos*”""! (@) sin-” '(@) p2mt2n-l oT" dr d@ 
6=0 #r=0 


Z n/2 
= 4 I p2mt2n-l y-r* tr | cos”! (8) nO) 


0 0 
= 2 B(m, n) [ p2m+2n-le-r’ dr (using Eq. (1.86)) 
0 


We also have 
Fae wy Gee: | pomten-lo-r" dr. (set x = ah I 
0 


(m+n) = [ 


0 
Combining the two results, we obtain 
Pom) G 
['(m)T(n) = B(m, n)U (m+n), or B(m,n)= ee 
5S. B(m, n) = B (m+ 1,n) + Bim n+ 1), 
We have 


ni2 /2 
B(m+1,n)=2 | sin*”*! (9) cos"! (9) d@ = 2 | sin”! () sin? cos2""! (@)d0 
0 


rr 
0 


mi2 
=? [ sin’ (8) cos?! (9)(1 — cos*@)d@ 
0 


mi2 m/2 
=2 [ sin" (9) cos?" (9)49— 9 | sin*”"! (@) cos?"*! (9) dé 
0 0 


ce B(m, n) = B(m, n+ 1) 
Therefore, (m,n) = B(m + 1,n) + Bom, n+ 1). 


-] 
le 1.53 Given th x = 2 np 
Example Given that I l+x  sinpm’ show that (pT (1 ~P)= ox 











Solution Let 





_— — | _ sy 
wee. Solving for x, we get x = = and dx = . _ dy: 


| a i (pra - 
Then, 1= [ ax |»? (1 - y) NPBA ~ gh EE origrit gi 





Hence, the result. 





Functions of a Real Variable | 65 


Example 1.54 Evaluate the following improper integrals 
(1) | Vx en? dx, (11) { e-* dx 
0 0 
in terms of Gamma functions. 
Solution 
(1) Substitute x = Jt. We get dx = dt/(2Vt) and 


te [Vee Pace dP tera d [" 1oe-teare Lr (3) 
I 2 J, e 2 J, ! edt a a} 


(11) Substitute x = 2'”. We get dx = 41? dt and 
| - wail | | al 4 : | cs] 7 7 | a 

/ — ti=-= 2/3 , =_=_— (1/3)-1 P ==> E ) 

=| dx a. e ‘dt 7a e ‘dt 5 | 5 


Example 1.55 Using Beta and Gamma functions, evaluate the integral 


[= | (1 — x*)" dx, where n is a positive integer. 
-| 


] 
Solution We have fs | (l+x)"(1 —x)" dx 
-| 
Let | + x = 2rf. Then, dx = 2d? and 1 -— x = 2(1 — r). We obtain 
| 
I= 278") | (1 —1)"dr=2-"*! Bin + ln +1) 
0 


Cin+ 1) PT (n+ 1) _ 2%**! (nt)? 
(2n + 2) ~  (2n+ 1)! ° 


2n+l 


er | 
_— <a! 


Example 1.56 Express | x™(1 —x?)"dx in terms of Beta function and hence evaluate the 
0 
integral | x%2¢1 ~ Vx)? dx. 
0 
Solution Let x? = y. Then px” ~ldx = dy. We obtain 


l | 
io | x™ (1 = zr y dx= E | yi Ptr ey ed y)" dy 
0 P Jo 





e | f | 
= 2 [ yorwora -yyrdy=4p( "= net) 
P Jo p\ # , 
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_ iven integral, we fing 
/2 dx with the given in that 
ring the integral | x? (1- vx) 
Now, comparing 8 : 


m = 3/2, p = 1/2 and n = 1/2. Therefore, 


I 3 21 (5) (3/2) 
| PP (1 — Jx)'"dx= 2AI 5. 4 ~ T1372) 
0 
3 
I3)_U 9.7.5.3 >| - 10395 (5). 
— rs) =at=24,0( >] = 3-3-3 2 (3 32 (2 
2(24)(32)T(3/2) _ 1536 12 
Hence, f= = 


= “703951 (3/2) +-10395 3465 


Example 1.57 Using Beta and Gamma functions, show that for any positive integer m 


ae (2m — 2)(2m-4)...2 
) ) sin" (8)d0 = (2m —1)(2m—3)...3° 


ae, [Os am (2m - 1)(2m-3)...1 7 
(11) j sin? ane =a > 


Solution From Ec. (1.86), we obtain 
] aha l l m/2 
p{ m >| =2 [ sin*”-!(@)d@ and p{ m + 5, | = 2 | sin?” (0)d@. 
2 P . ; 


ml2 
ee | (2-1) _1 L\ _ [(m)T (1/2) 
(1) I= | Sin (@) d@ = 5b{m. 5) ~ 20 (m + 1/2)’ 
We have I'(m) = (m — 1)!, and 


ry fy 3 
ode 8). els 

“pe lam—Heam—3)...3-yr(2) 
Therefore, 


- (mi — 112" T(1/2) m-I _ 


(2m — 1)\Qm—3)...3-] 
_ (2m ~2)(2m~4)...4.2 
~ (2m — 1) (2m =3)...3- 7° 


73 |°S>. 


mie 
(ii) =| sin" (9)d0 = 7 B[ m+ | =i (e+ 2) rae 
0 2 20° (m + 1) 
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—_ = 


(2m — 1) (2m - >) 





























| (2mm — 1)(2m -— 3)...3 4 ws r) 
= = fee Se ps (yx)* = 
2(m!) | 2” : 2™ [mim — 1)...2-1 
_ Qm- 1) Qm-3)...3-laz 
(2m)(2m—2)...4-2 2 
Example 1.58 Evaluate | 2-9" dx using the Gamma function. 
0 
Solution We write 
f= | 5-91 dx= | eer a2 dx 
) 0 
= W722. 
Substitute 9x* In 2 =y. Then, x= Ee wai des 2 2 . 
3VIn2 6 In 2 
Therefore. j=— | yt edly = 1_ | yr te"? dy 
6ViIn2 Jo 6vIn2 Jo 
_ rda/2 _1 | 9 
6VIn2 6 \ln2 
Example 1.59 Show that 
a 
P(Qn)==— Pines (nm) (1.89) 
ri\—{3 ~ 
and rl) r(z) = V2. (1.90) 
Solution From Eg. (1.88), we have 
I (m)P(n) meg ‘ 
a = Bim, n)=2 J sin (8) cos 7! (0) 8. (1.91) 
Setting m =n, we get 
[T(n)}? iJ a . 
T(r) Bin, n) =2 sin * (8) cos*' (6) 6 
: #0 
1 aj2 
“str | sin (20) de. 


Substituting, 20 = 5 — , we get d@= -+ dg. Hence, we obtain 
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[T(n)}? _ -l {- cos2""! (6)do 


P(2n) 21 Jon 
fs do=— i cos"! (6)d@ 
i 9 2n-1 J COS dad = qin-l 0 (1.92) 


since cos @ is an even function. 
Setting m = 1/2 in Eq. (1.91), we obtain 


a/2 
T(n)t le) P(d/2) -3 | cos“! (8)dé. (1.93) 
IT (n + 1/2) 0 


Comparing Eqs. (1.92) and (1.93), we have 
(Tinh 4 Pn 





T(2n)  22™1 | T'(n + 1/2) 
| _ 2 2n-| ” : es _ 
or [(2n) = ae ['(n) T(n + 1/2), | since r| 5 | Va | 


which is the required result. 
Setting n = 1/4 in Eq. (1. 89), we obtain 





1 7 4-2 S (2 
(3) = = rary 
or r 7)r(>)- V2 
a)! (g) = 92. 
a/2 
Example 1.60 Show that [ Vtanx = 4. 
. 2 
Solution We have 
mi2 mlz 
I= | Vianxdx = | sin’”* x cos-'/2 x dx = 1, 31 
0 0 2 \4'4 
_ 1 T4104) V2 7 | 
7 (1) == = Va (using Eq. (1.90). 


1.5.5 Improper Integrals Involving a Parameter 
Often, we come across integrals of the form 


2b(a) 
O(a) = f(x, @) dx (1.94) 
"a(a) 
where @ is a parameter and the integrand f is such that the inte 


gral cannot be evalua standard 
methods. We can evaluate some of these integrals by differen evaluated by 


tiating the integral with respect to 





. 
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parameter, that 1s first obtain @ ‘(c), evaluate the integral (that is integrate with respect © 2) ana then 
integrate @’(4) with respect to & Note that f is a function of two variables x and &@ When we 
differentiate f with respect to @, we treat x as 4 constant and denote the derivative 2s Of 9a | pau a) 
derivative of f with respect to @ Chapter 2 discusses partial derivatives in detail). We assume thai /. 
fla, a(a) and b(@) are continuous functions of @. 

We now present the formula which gives the derivative of Of). 


Theorem 1.16 (Leibniz formula) If a(c), b(@). f (x. @) and df/og are continuous functions of a. 
then 
do ("” of db da a 
— = — /( 4 jee tae i 1.95) 
AG |. a x, A)dx + fb. OT fla, a) er 


Proof Let Ac be an increment in «@ and Aa. Ab be the corresponding increments im a and 5. We 
have 


b+ Ab 
Aob= (4+ Ad) -— O(a) = | 


a+ 0 


f(x.a@+ Agjdx - | f(x. ajdx 


= 
oo 


dl u o* oo | as 
=| flxa+ dade | flz.a+ dade + | flx.a+ Sajdx - | f(x, ajax 


i+Aa : 
Ap [7 4 f l ver » — 
cA re ee oes + | ——I[flx,a+ Aa) —flx, ajlidx 
or An |. f(x, a+ AGjdx Li if f 
oe i 96 
+| Ag sf 6% 4+ 4ajdx 


Using the mean value theorem of integrals 


5S 
| f(x)dx = (x, - x6) (6), 49 < $< 5; 


xy 
. - 
we get | f(x, @+ Aajdx = -Aaf(,,a+ Aa). a< ¢, <a+ Aa (1.97) 
a+Aa 
b+ Ab | 
and | f(x, a@+ Aajdx = Abf(¢,,a+ Aa), b< €- < b+ Ab. (1.98) 
b 
Using the Lagrange mean value theorem, we get 
d 
f(x, a+ 4a) - f(x, a) = Aa SF tr.&)a<b:<a+ sa (1.99) 
We note that 
jim, 51 = jim, 62 = band jim, £5 = « 1100) 


Taking limits as Aa — 0 on both sides of Eq. (1.96) and using the results in Eas. (1.97) to (1.100). 
we obtain 


do f° of - db da 
— = —(x,@j)dx — — ;—. 
da J da” i i da f(a, @) da 
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Remark 8 
(a) If the limits a(a@) and b(a@) are constants, then we obtain from Eq. (1.95) 
do. f SL (x, a)dx. (L190) 
(b) If the integrand fis independent of a, then we obtain from Eq. (1-95) 
4 - 7H) 8 - fa Sy lime 


(c) Leibniz formula is often used to evaluate certain types of improper integrals. 


~ e@ ™ sinx 4, g > and deduce that 


Example 1.61 Evaluate the integral | 
0 


co ” sin ax IC 
sin Xx 1 = : 4 Q. 





e =" Sip: 2" .. (1.103) 


Solution Let @(q@) = | —— ax. 
4 : 


The limits of integration are independent of the parameter a. We obtain 


do a 0 ee e* sin x i xe 64 sin x - : 
aa ee ee lay = — —$—$$§$§$<$§— dy = -— e-"* sin Fax. 
# () 0 








da” J, 0a x x 
i & ax 5 
Using the result [e« sinx dx = — = am (@ sin x + cos x), we obtain 
do —ax = 
a gr (asin x + 00s x)| = | 
l+a ‘ 1+a? 


Integrating with respect to @, we get 
@ (&) =— tan” a@ + c, where c is the constant of integration. 
From Eq. (1.103), we get the condition @(cc) = 0. Hence, 


Mo=0=—tano4+e¢ of c=. 


Therefore, a | "en ex sin 
9 (a) ) ae te = 5 —tan'q. 
(i) Setting @ = 0, we obtain [ sin x soil 
5 x an 2" (1.104) 


(ii) Substituting x = ay on the left hand side of Eq. (1.104), we obtain 


| ay dx= | BOY a 
o * J y Zi’ 


Functions 


Example 1.62 Using the result | ras dx = ae, evaluate the integral 
0 


Solution Let @(@) = | e-** cos (2ax)dx. 
0 


The limits of integration are independent of the parameter @. Hence, 


ae [. <s [e7* cos (2ax)|dx = | (- 2x)e* sin (2ax)dx 
da J, da 0 


= [e7* sin(2 ax)]o —2a | ox” cos (2a@x)dx = —2ao. 
0 
nik 


| d , 7 
Integrating the differential equation < + 2a = 0, we obtain 9(@) =ce 


From Eg. (1.105), we get the condition ¢(0) = | e7*” dx = ae, 
0 
Using this condition, we obtain 9 (Q) = ae ='C. 
oo Jn a? | 


Therefore, @(a@) = | e-** cos (2ax)dx = ie 
P 2 


co = 
Example 1.63 Evaluate the integral | LD) dx. a>Oanda # l. 
9 x(1+x*) 


oe -1 
Solution Let @(a)= | Ca 
0 


x(l -x*) 
We have 
dg = “ oO tan™ (ax) ax= [. en 
da 0 da} x(1+ x?) 9 (+ x*)(1 + a* x?) 





—_ [l= -Els 
a? —1Jy La?x?+1 14x? |" 


] 
= [{atan“'(ax)}G — “iy on | GS 1 | ___ 
a? ax)}f ~ {tan(x))§] = 2 4 . | sea 








Integrating with respect to a, we obtain 


d(a)=>In(a+ l) +e. 


From Eq. (1.106), we get the condition (0) = 0. Using this condition, we obtain @(0) = 
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| o-*’ cos (20x) dx. 
0 


(1.105) 


(1.106) 


0: = ¢. 
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oo ta -| | : 
Therefore, 0(a)= | =e dx= 4 In(a + 1). 
Jo (1 - ) 


1.5.6 Error Functions 


Error functions arise in the theory of probability and solution of certain types of partial differentj.) 
equations (see section 8.7). 


Let us first consider the following function that arises in defining the normal probability distributio, 


(the case when mean = p = 0 and variance = 0” = 1) 


l oe 
f(x) = Jon é = . (1.107) 


This function is also called the Gaussian function. The bell shaped normal curve defined by 
Eq. (1.107) is given in Fig. 1.20. The area under the curve and above the x-axis 1s given by 





: ; = | © et 2dx (1.108 
= | = | . »1U0) 
if [ f(x)dx i 
f(x) 





Fig. 1.20 Normal curve. 


Setting u = x//2, we get 


l “ 2 
f=—— e" du. 
zl. 


It was shown in equation (1.81), that 


pice. t= | f(x)dx= = [_ e~” du = 7 af ~ i 


that is, the total area under the normal curve is 1. Since the area is symmetric about the y-axis, We ge 


0 on 
| fix)dx= | f(x)dx= 
‘() 


in 


1 
% 


The area under the curve, from — ° to any point z, is given by 
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: ed. (1.109) 


oa) =e | 


Hence, by definition ¢(0) = 1/2. The function $(Z) is call 
distribution with mean 0 and variance 1. Setting x =— Y in 


oY dy = ] | eddy 
—< 


Jon 


—< 
en 2dy — ] [_« av 2 dy 


jan 


ed the distribution function of the normal 
Eq. (1.109), we get dx = — dy and 


9(Z) = “Ts { 
“del 


= 1 — o(-z) 


or o(—z) = 1 — $(z)- 
Values of the distribution function are tabulated for various values of Z. Further, 


curve from x = 0 to x = z is given by . 


: 0 
I(z) = = [ e-* dx = 2 [ en 2x — | eX dx | = o(z) - > (1.111) 
4{ 2% 0 a 270 oo —o 


or o(z) = “ + 1(Z). 


(1.110) 


the area under the 





Error function erf (x) 
The error function is also called the error integral function. It is defined by 


erf (x) = en" dt. (1.112) 


x), 





| | 1 
9 —_ 1 — 
Let 2 =u. Then, dt = y du = oi; du, and 


; 
i.” 2 
erf (x) = | ua" du, 
cope (1.113) 
This is another form of the error function. Using this definition, we obtain 
erf (00) = witertdy = r(3 s\-+ —— 
|, TaN Fe We) | (1.114) 
Let #2 = u2/2 in Eq. (1.112). Then, 
d 
2tdt=udu, dt= es du = = and 
V2x 
—u/2 du _ af) 2x wate 
erf (x) = = e =z) edu. (1.115) 





e* Fdx= O(V2 x) — 5- 
(1.116) 





———— 


Usrme Ec {]- 11: 
35 

ing 2d x= = [ 

¥— 0 


: i> > — 341472 x) — 1. 
erf (x) = 2i(w2 x)= -Otv=-F) 


Theretore. 
Hence. the error function can be evaluated using this relation. 


Complementary error function <7c (=) | 
n of the error function given in Eqs. (1-113) and (1.114). we write 
A 


FIMO 
= ae 2 
l un -e *du —_ | yw 66h €E + du 
6 vi I 


Usme the de 
| uo -e *du = . 





(1.117) 


~~ Kk 


where we define 
erfc( x)= == u~Y*e-*du. (1.118) 
; Va Je 
This function erfc (x) is callea the =mplementary error function 


Using Eqs. (1.117), (1-112) and (1.114), we can write 
e dt 


; erfce(xy=1—erf(x)=1->= 
wi df 
2 fF" 2, 39 £ 12 2 ft #2 | 
oo e dt -—= Par= 2 | eo dt. (1.119) 
VK j wT Jo V1 Vs 
Equations (1.112) and (1.119) are the commonly used definitions of error function and complementary 


error function respectively. The graphs of ef (x) and erfc(x) are given in Fig. 1.21. 
(1.120) 


Some properties of error functions 
1. erf (—x) = — erf (x). 


Sse ee Fe Se ee ee eee ce 
fe 2S eS Se 
-=—=—_— = 


x 





0 
Fig. 1.21. Error function and complementary error function. 
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Using the definition given in Iq. (1.112), we get 


erf ( *)= | e' dt= + | e“ (~du) (setting f= —u) 





= — erf (x). 
2. erfc (-x) = | + erf (x) = 2 — erfe (x). (1.121) 
Using equation (1.117), we get 
erfc (-x) = 1 — erf (-x) = | + erf (x) 
= 1+ (1 - erfc (x)] = 2 - erfe (x). 
3. Derivative of error function We have 
7, bert (ax) = 7" (1 .d2Z) 
From the definition, we have 
5 (£0 ' 
erf (a n= | er at. (1.123) 
Vm Jo 
Consider x as a parameter. Comparing Eq. (1.123) with Eq. (1.94) 
b(a) 
o(a) = | f(x, @)da, where @ is a parameter (1.124) 
a( ce) 
we get f(t, x)= qe en! , B(x) = ax, a(x) = 0, G(x) = erf (Ax). 
Using Eq. (1.95) 
b( a) da 
ae. OS x, ada + f(b, a) 2 - f(a, a) (1.129) 
da a(a@) 
we obtain 
rr a 
jante (| le” Dat £ (ax) - 
Lert (ax)I Itt I ae )dt + f(Ax, x) A (ax) -0 
26 po? 
NE 
A, Integral of error function We have 
i 
_ 7 | ~ce*y¢ (1.126) 
rf (Ax)dx = terf (at) + -[e - | 
[er rdx = terf =e | 


Inteprating the left hand side by parts, we obtain 
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f f d 
| | - erf(ax)dx =([xerf(ax)], - I xa [erf (ax)]dx 
0 ' 


2a i =x 
= rerf(at)-e | 4 dx 


; = dul(2a”). Hence, 
using Eq. (1.122). Let a?x* = wu. Then, 9a2x dx = du or x dx dul(2a*) 


2,2 





2a ] ae ee 
j erf (ax) dx =terf (at) - (7 | sas ss] f e- “du 
| oe en ae 
abe (a ie le \, 
L_je 1). 





= terf (at) + ain” 


Exercise 1.4 
In problems 1 to 25, discuss the convergence or divergence of the given improper integral. Find its value if 


exists. 


"i Inx 
” I 4+x° o [* dx, 3. | +& 
~ xdx 
4. = 
I ode os | I 
7. { xe dx, . [| —#_ 
x? SS 9, 
dx, 0 x+4 
| toy OY SP <I, 12. [ <r dx, 





x? x2 4.2%" 


re" dx, a> 0, 6. “4x gin bx dx, a>, 





--.; 








= | — nu. | 2° 
0 
"dx 
13. [ ' 14 
o we tl [* ™ 
: woe 
16 we dx 
. ‘ cos x’ 17. [ In x dx, " 
' dx ; a maj 
” J xt 20. | sg 
_ * ; rar _ ty 
R/2 sin” 
‘2 | dx 23, [ _sinx _ 
Ig x 3 x(Inx)2 @ 24. SBE ae 


25, | x! 
) t t x! 


ds. 


jq20, 


WnNjyq<0 
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In problems 27 to 40, evaluate the intevrals using the Beta and Gamma functions 


2h, 


24. 


32. 


35. 


3H. 


ni} 
| dx 
) AAT 


Con” O dO, m inleper 


[ 
(o 


x? ey dx, kx 0 


(,8§ > Ok oO. 


[ ue a 


= 


Establish the following results. 


Al. 


42, 


43, 


44. 


47. 


44. 


49, 


x™(p4 -xtyt de = ( 


( 





mang + | ! 
P Bln 
q q 


ai? 
27, | sin’Ocos* Odd 
i 


} 


). | xVa® - x? dx 
f) 


tf 


33. 4 


36. Ax 
0 l +x" 


~,2 
| t*e" dt. 
( 








25. 


31s 


37. 


| sin’ @ cos°@dé@. 


| 
| dx 
() ‘I -x? | 





x 
9 J -Inx | 


<* | 
| BX, a>. 
fj a 
4 ..o2 
| gh? o>” dx. 
f) 


} m, n, p,q are positive constants 


(x—a)y™'! (b= x)"'dx =(b-ay”"! Bim,n), m,n,a, b are positive constants. 


j 
fee 4 (5 
J 


| enh n! é 
m_~x?y" = ———————,, nis a positive integer. 
M My ae ee iy = B 
\ | 
[= x" dx =m"! B(m,n-+ 1), m,n are positive constants. 
0 


x" ¢@ 


> 


(=1)" a! 


ey x 


n mae 
em (Inx)"” dx eee 


~ or Tay ele (pRTD 


| r( 
"dx = nam bin | oA 


m+ 1! 





yar 


O<pe< [eventha f 
| 70 


| } m,n, & are positive constants. 
[. e™ (Ll-e" ‘)"dx = Bh (m,n+ 1), m,n, are positive constants. 
m > | and n is a positive integer . 


pel 
(ll dx = 


1+. 


min ] 
————_—_—_———— |, a, b, m,n are positive constants. 
E sin ‘aaa me 


9 
sin pi | 
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50. For large n, n! = .{2an n" e-" (Stirling’s formula). 


lg"-l Gosh | 
cS a oe 
od j (a+ bx)”"*" B(m, n) 





~ a" (a+b)” 
Using the concept of differentiation of integrals (assuming that the differentiation is valid) evaluate the following 
integrals: 
re e~ax _ ex ’ a x? 
52. dx, a>0,b>0. 53. [ Sqgias a> b>-t. 
0 x 0 log x 
| n/2a 
34. | x" (log x)* dx, n any integer > — 1. 55. | asin ox dx. 
0 0 
- 3 oo : a3 
56. | xe"* dx, where | e° dx 7, 57. | cot! (x/ar? )dx. 
— oo  —oo 0 
sg, [ ——©0Sx___ ay given tat [ __ ae gh bo 0, 
9» (at+bcosx)? » at bcosx at — be 


” ME 
59. | e-*’-(@? Ix) qx a> 0, given that | e-* dx= = 
0 0 : 


ri ao dx 7 a 
60. | log (1 _ a? sin 2 x) dx, | x | < | 61. | Ge +1)" n any positive integer. 
0 0 


z 


d 2a ey. 
62. Show that = [erfc(ax)] = a = e 


9 x3 5 7 
63. Show that erf (x) = fol s- 3) + 3a - FG Ps | 


f 


_ { ry: 
64. Show that ax)dx=terfc (at) —- € — 1}. 
OW tna | exte x) rf ( ) mm ] 





65. Show that | e-M2at gp — <2 e” [1 - erf(a)]. 


0) 


66. The relation | e-*” cos (2bx)dx = az 


e-”” is given (see Example 13.40). Deduce the result for 
0 


| et *x? cos ( px)dx. Integrate this result with respect p, taken as a parameter, from p = 0 to p=5 and 
0 


a sete sin (sx) _ Ss- 
show that | . ( x Jax - 2 ot (= } 
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Functions of Several Real Variables 


rmA | < 





2.1 Introduction Yo ' =<) ae 

Py i = ; , nN. 
In Chapter 1 we studied the calculus of functions of a single real variable defined by y = f(x). In this 
charter we shall extend the concepts of functions of one variable to functions of two or more 
variables. 


If to each point (x, y) of a certain part of the x-y plane, xe IR, ye IR or(x,y)€ IR xX R= R’, 
there corresponds a real value z according to some rule f(x, y), then f (x, y) is called a real valued 
function of two variables x and y and is written as 


z=f(x,y),xe R,ye Rror(x, ye R*,ze R. (2.1) 


We call x, y as the independent variables and z as the dependent variable. 


In general, we define a real valued function of n variables as 
ih = f (%1, XQ, + 2 +9 Xn) (x1, XQ, s+ 5 Xn) c IR", ac JR (2.2) 
where x), X2, - - -» Xn are the n independent variables and z is the dependent variable. The point 


ieee. --;X,) 1S called an n-tuple and lies in an n-dimensional space. In this case, the function f maps 
IR" into IR. - A+ @ | 

The function as defined by Eq. (2.2) 1s called an explicit function, whereas a function defined by 
Sikes. -; X,) = 018 called an implicit function. 

We shall discuss the calculus of the functions of two variables in detail and then generalize to the 
case of several variables. 


2.2 Functions of Two Variables 


Consider the function of two variables 

oS 7%, 3): (2.3) 
The set of points (x, y) in the x-y plane for which f(x, y) is defined is called the domain of definition 
of the function and is denoted by D. This domain may be the entire x-y plane or a part of the x-y plane. 
The collection of the corresponding values of z is called the range of the function. The following are 
some examples 








> m “ P _. 
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| > >. > 2 “2 1. 
12 - = is real. Therefore, we have 1 — x~ — y~ => 0, or x“ + y~ <1, that ts, the domain 





is the region x° + y- < 1. The range is the set of all real, positive numbers. 
The domain is the set of all points (x, y) such that x* — y’ #0, that is y#+-x. The 
range is IR. 
z= log (x+y): The domain is the set of all points (x, y) such that x + y > OQ. The range is IR. 
The domain of a function and its natural domain can be different. For example, we have 

f (x, y) = area of a triangle = x y/2 
where x and y are respectively the base and the altitude of the triangle. The domain ts x > 0, y > 0, 
whereas the natural domain of the function is the entire x-y plane. 


Consider the rectangular coordinate system Oxyz ( Fig. 2.1). 


— — _—_-— 
= 





O(0, 0, 0) 





(a) Y) 


Fig. 2.1. Function of two variables. 


At each point P (Xp, Yo; 0) in the x-y plane, construct a perpendicul ar to the x 
Z - it - = PO = Zo =f (Xo; Yo). This gives a point O(x, : 
€ 10Cus Of all such points (x, y, Z) Satisfying z=f(x ) cn es 
re ae peer (<©=J, y) is called a surface. For ‘ss 
. the ey z=x+y’, (x, y) € IR* is the paraboloid of revolution as Piao tae = on 
perpen cular to the x-y plane intersects the surface z=f (x, y) at exactly i. elas cok 
at no point if (x, y) €D. ; “acUy one point if (x, y) € D and 


-y plane. Take a point 
Yor Zo), OF Q(X, yo, F (Xp, Yo)) in space. 


The graph of z = f (x, y) = c, where c is a real 

: abas3 SS 5 | ai Constant a le 

paraboloid of revolution z = x7 + y?, the level curves we the Ec eee oat eaemple, for the 
We define the following: _™ Sie @. 





fwo points Let P(x», yo) and O(%, y;) be any two points in IR*. Then 


af, 2 ='FOT= JG, 2 

ees : 1— Xo)” +€y; — yo)? 

_ IS Called the distance between the points P and O. - a (2.4) 
% a 
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Neighborhood of a point Let P(x, yo) be a point in IR*. Then the d-neighborhood of the point 
P(xo, Yo) is the set of all points (x, y) which lie inside a circle of radius 6 with centre at the point 
(xo, Yo)» (Fig. 2.2). We usually denote this neighborhood by NV5(P) or by N(P, 0). 








Fig. 2.2. Neighborhood of a point P(g, yo). 


Therefore, 


Me(P) = (2,9): {= 20)? + = 0)? < 5. (2.5) 
Since |x-—xo |< y(x-x0)* +(y-—yo)* and |y-—yo|< ¥(x-2x9)? +(y—yo)?. 


the neighborhood of the point P(x, yo) can also be defined as 
, BletP) = {, y): |x- x0 | <0 and |y—yo|< 5d}. (2.6) 


that is, the set of all points which lie inside a square of side:20 with centre at (xo, yo) and sides parallel 
_ to the coordinate axes (Fig. 2.2). mee 
bi If the point P(xq, yo) is not included in the set, then it is called the deleted 6-neighborhood of the 
point, that is, the set of points which satisfy 


0< V(x-x0)? +(y—y0)? <5 (2.7) 


is called the deleted neighborhood of P(x, yo). 


Open domain A domain D is open, if for every point P in D, there exists a S> 0 such that all points 


in the 6-neighborhood of P are in D. 


Connected domain A domain D is connected, if any two points P, Q € D can be joined by finitely 
many number of line segments all of which lie entirely in D. 











ded domain A domain D is bounded, if there exists a real finite positive number M (no matter 
how large) such that D can be enclosed within a circle with radius M and centre at the origin. That 
__ is, the distance of any point P in D from the origin is less than M, | OP |< M. 





A closed region is a bounded domain together with its boundary. 
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Bounded function A function f (x, y) defined in some domain D in IR? is bounded, if there exists 
a real finite positive number M such that | f (x, y) | < M for all (x, y) € D. 


Remark 1 


(a) The domain of a function of n variables z = f (x), x, . .. , X,) is the set of all n-tuples in IR” 
for which f is defined. 
(b) For functions of three variables, we need a four-dimensional space and an (n + 1) - dimensional 


space for a function of n variables, for its graphical representation. Therefore, it is not possible 
to represent a function of three or more variables by means of a graph in space. 


(c) Fora function of n variables, we define the distance between two points P(x;9, X09... ., Xno) 
and O(x)1, NO [so «oy Xn1) in Ik” as 





; ; 2 
(x1) - X19) + (Xo; — X29)? Fe HN ong) 


“| PQ|= 


and the neighborhood N;(P) of the point P(x19, x29, . - -, X,9) is the set of all points 
(X}, X2, . . ., X,) inside an open ball 








: : 2 2 
(x1 — 10)? + (x2 — x29)? +... 4 (x, —Xn0)2 <6. 


2.2.1 Limits 


Let z= f(x, y) be a function of two variables defined in a domain D. Let P(x, yg) be a point in D. If 
for a given real number € > 0, however small, we can find a real number 6 > 0 such that for every 
point (x, y) in the 6-neighborhood of P(X; Yo) 


|f(% y)-L|<e, whenever f(x — x9)? +(y — yo)? <6 (2.8) 


then the real, finite number L is called the limit of the function f(x, y) as (x, y) > (xo, 


Yo). Symbolically, 
We write it as 





f(x,y) =L. 


lim 
(x, ¥) > (x9, yo) 


Note that for the limit to exist, the function f(x, 
not defined at P(x9, yo), then we write 


|f@, y)-L|<e, whenever O< V(x — x9)? + (yy)? <6. 


This definition is called the d-¢ approach to study the existence of limits. 


Remark 2 
a) lim I (yy), 


| (x, ¥) > (x9, yo) 


y) may or may not be defined at (Xo, Yo). If f(x, y) is 


if it exists is unique. (The proof is similar to the case of functions of one 


7 variable), 
nf (b) Let x =r cos 0,y=rsin @ so that x2 +y=r 
Sy om given in Eq. (2.8) as 
“a 5 lim | f(r cos er sin@)-—L|<é, whenever pe 0, independent of @. 
a 
a 


and @=tan"!(y/x), Then, we can define the 





aS 
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(c) Since (x, y) — (9, yo) in the two-dimensional plane, there are infinite number of paths joining 
(x, y) to (Xo, Yo). Since the limit is unique, the limit is same along all the paths, that is the limit 
is independent of the path. Thus, the limit of a function cannot be obtained by approaching the 
point P along a particular path and finding the limit of f (x, y). If the limit ts dependent on a 
path, then the limit does not exist. 

Let u = f(x, y) and v = 7 (x, y) be two real valued functions defined in a domain D. Let 


f(t) =1, and lim g(x,y)=L,. 


(x, ee, yo) (x,y) — (40; Yo) 
Then, the following results can be easily established. 


(i) oa) eS Lk f(x, y)] =kL, for any real constant k. 


(ii) lim (f(x,y) g(x,y] =k, + ly. 


(x, ¥) — (x6, yo) 


(iii) lim [f(x, y) a(x, y= LL. 


(x,y) (x9. yo) 


(iv) (tim Lf ya (x, y)] = Li! Lz, Le #0. 


Remark 3 
of 
Let z=f (x, X,..-, X,) be a function of n variables defined in some domain D in IR”. Then, for any 
fixed point Po(X10; X20 ++ +9 Xn0) in D 
plim f(*19%2> es 





if | f(x, x2, . - -, X,) - L | < & whenever (x; = Kio)? bilks —Xog)? Fe. (Xe — Keg)? < 6 
where P(x, x2, - - -» Xn) is a point in the neighborhood or the deleted neighborhood of Pp. 


Example 2.1 Using the 6-€ approach, show that 


( = 10, lim x7 +2y)= 
) cw yhile. mex + 4y) = 10, er se nN oe 









s') Here f(x, y) = 3x + 4y is defined at (2, 1). We have 
| f@, y) - 10| =| 3x + 4y - 10] =|3@-2)+4@-1)|<3|x-2|+4]y-1]. 
aE: we take | x — —2|<6dand|y—1|<6, we get | f(x, y)- 10|<78< €, which is satisfied when 








s eae ¥ = 10. 
Pe < lim wa » 





fe rs - Mice Reid, ye 7; 

: = GN 2G— 142 —1)|<|x-1 |? +2(x-1])*2|y-1| 
If wi Ba, < dand|y— 1/<6, we get | f(x, y) — 3 |< 6° +46< which i is satisfied when 
| (642)! <€44 or6< Jer 4-2. 


E 
, 
a ; 
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Hence, lim f(x, y= 3. 
yy (1,1) 


(x, ! 
We can also write .y)-3|<6°+46<50<€ 






_which is satisfied when 0= €/5. 


Example 2.2 Using 0-€ approach, show that 
Nyt AZ YZ 


: = | 00) lim 
Oo eghe.o Veep? | a 0.20 fx? + y? +27 


Solution 


(i) Here f (x, y) = xy/(./'x7 + y”) is not defined at (0, 0). We have 


= (Q, 











, 2 2 ; 7 
mo) | Se... cb OY 1 fa? 45? <8, (zy) 40.0) 
x? + y* Nig ay : [2 +? 


since | xy | < (x? + y*)/2. If we choose 6 < 2¢, then we get 
eS ee 








xy 2 | , . 2 2 
reg -Q|<€é, whenever 0< Vx* +y*<6. 
x°+y 
Hence, li a =). 





(x, y) > (0,0) 2 a y? 
Alternative Writing x = r cos 0, y =r sin 0, we obtain 


xy 
8 


2 r* sin Ocos @ 
Abe en © | r 


= him 
r— >() 





lim 
(x, ¥)— (0, 0) 








which is independent of 6. 


(ii) Here f (x, y, z) = (xy + xz + yz)/ yx? ty? +2? is not defined at (0, 0, 0). 


Since | xy | < (x7 + y*)/2, | xz | S$ (x? + 27/2, | yz |< G* + 2/2, we get 


xy + xz + yz 
x? + y? + 2? 





2 
of 4] pe ee tye 


2 
: : sue ATE aa ) 
ie re | Wate ya? | <e. 





Tf we choose 6 < €, we obtain 


: 
Pa ¢ 


AM + XZ + V2 
xy a, 


<€ whenever O< [x2 4524 22-9 












fence AY + XZ + yz | 
aS ee 


” €5;,3 Ae ot | =i 
(x,y,z) (0, 0, 0) me + y2 ge 


= 0. 


SS ———— ll 
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Example 2.3 Show that the following limits 


vol lim > fa) lim ade iow 
YO (FOO X* + y? | 5A hie 9 -y Poe 


Ve 
ih lim iis a : an~'( 2) man v 


» 2 a a 


ev pret 


(x,y) (0,0) x® 4 y? Aes 1) 


do not exist. 


Solution The limit does not exist if it is not finite, or if it depends on a particular path. 


(i) Consider the path y = mx. As (x, y) — (0, 0), we get x — 0. Therefore 


2 
| mx m 
(x,y) 0,0) x2 4 y? x90 (L4m?)x* 1+ m? 
which depends on m. For different values of m, we obtain different limits. Hence, the limit 
does not exist. 


Alternative setting *= COS 8, y=r sin 0, we obtain 
Pe Are | 
ne = in sin Ocos G 
(x,y) 3 (0, 0) x2 + y* r>0 r2 


which depends on @. Hence, the limit is dependent on different radial paths 8 = constant. 
Hence, the limit does not exist. 





= sin @cos 0 


(ii) Choose the path y = mx’. As (x, y) > (0, 0), we get x — 0. Therefore, 
Hay 6. Veealin 
HM pe eee 
(x,y) (0,0) x2 +y x90 (1+ m)x 
Since the limit is not finite, the limit does not exist. 
(iii) Choose the path y = mx’. As (x, y) — (0, 0), we get x > 0. Therefore 
x *y mx ® m 


lim #=£o——>= lim zs 





which depends on m. For different values of m, we obtain different limits. Hence, the limit 
SE Ase cle 
an = tan (toc) = + | 


does not exist. 
ff We have 
| lim t 
(x,y) (, 1) x 


depending on whether the point (0, 1) is approached from left or from right along the line y = 1. 
If we approach from left, we obtain the limit as —77/2 and if we approach from right, we obtain 
_ the limit as 2/2. Since the limit is not unique, the limit does not exist as (x, y) — (0, 1). 
sig * 


2.2.2 Continuity 
A function z = f (x, y) is said to be continuous at a point (x9, yo), if 


lim, fey) =f (20. Yo). 













ed at the point (xo, Yo), ii lim xists, < 
Pp » Yo (11) yyy ew? exists, and 
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If any one of the above conditions is not satisfied, then the function is said to be discontinuous a; 
the point (x, Yo). 
Therefore, a function f (x, y) is continuous at (x9, yo) if | 
| f (x, ») —f (xo, Yo) |< € whenever (x- x0) + (¥- Yo ree. (2.9) 
If f (%p, Yo) is defined and f(x,y) =L exists, but f (xo, Yo) # L, then the point (x, yp) 





lim 
(x,y) (x0, Yo) h nib ¢ - 
is called a point of removable discontinuity. We can redefine the function at the point (xo, yo) as 
f (Xo, Yo) = L so that the new function becomes continuous at the point (x9, yo). 


If the function f (x, y) is continuotis at every point in a domain D, then it is said to be continuous 
in D. 


In the definition of continuity, lim f(x, y) =f(%0, Yo) holds for all paths going to the 

(x,y) (10, Yo) | 
point (x9, yo). Hence, if the continuity of a function is to be proved, we cannot choose a path and find 
the limit. However, to show that a function is discontinuous, it is sufficient to choose a path and show 
that the limit does not exist. hae 





A continuous function has the following properties: 


Pl A continuous function in a closed and bounded domain D attains atleast once its maximum 
value M and its minimum value m at some point inside or on the boundary of D. 


P2 For any number yp that satisfies m < lu < M, there exists a point (x, yo) in D such that 
f (Xo, Yo) = M. 


P3 A continuous function, in a closed and bounded domain D, that attains 


both positive and 
negative values will have the value zero at some point in D. 


P4 If z=f(x, y) is continuous at some point P(x, yo) and w = 8(z) is a composite function defined 
at 7 =f (Xo, Yo), then the composite function 8 (f (z)) is also continuous at P. For exam ple, the 
functions e*, log (x* + y’), sin (x + y) etc, are continuous functions. 


Example 2.4 Show that the following functions are continuous at the point (0, 0). 


4 4 
zy 2x7 + 3y" | 2x(x? = y? 
Ft 9) = Ye spy (x,y) # (0, 0) (ii” f(x,y) = ers (x, y) ¥ (0, 0) 


0 (50) = 0,0) ~ 0 » (x, y) = (0, 0), 


Sine” (e422 


| Ci) f(x,y) = 4 tan7'(2x+44y)’ (x, y) # (0, 0) 






1/2 » (x,y) = (0, 0). by 
Solution , ME thed) - Py Jay 


(i) Let x =r cos 6, y=rsin @. Then, r= x2 +y2 40. We have “oedingbe, 3-9 


ale 
| f(x,y) - £0, 0) | = oe EM | . |.r4(2 cos4 + 3 sin4g) 
r* (cos?@ + sin2 @) 


< r*[2|cos4 O|+3 | sin4 O|)<Sr<e 


Be ty a 
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or r=Jx?t+y’< al e/5 . 


If we choose fi < Je/5, we find that | f(x, y) -—f, 0)! < €, whenever 0< x? +y°<6. 


herefo le is continuous at (0, 0). 
Therefore, a My 9) O59) = aig 0) = 0. Hence, f (x, y) is 


(ii) Let x=rcos 6,y=rsin @ Then, r= x? +y? #0. We have 
2x(t7"y*) 
mer 


y 
_ 


=|27cos2@cos O\S2r<-E 4 — 


or raaix? ty? <e/2. 


If we choose 6 < €/2, we find that 


lf (x,y) -f(,0)1<e, whenever 0 <x? +y°< 6. 


Therefore, Rt F(5-y) = Oy 0) -=10.. Hence, f (x, y) is continuous at (0, 0). 
(x,y) (0, 0) 


If (x,y) =f, 0) 1 = 


| | 21? os?0 — sin“) cos @ 
— 2(cos26 + sin? 8) 











(iii) Let x + 2y = t. Therefore, t > 0 as (x, y) > (0, 0). 


We can now write 












preied . etl Y/t ' 
fea ee et eer | Ma | i | il 
(x,y) 90, a IS tan} 2¢ 10 te (2t)/(2t) | l2t) 2° 
Since i. f(x,y) =f, 0) = 5 . the given function is continuous at (x, y) = (0, 0). 
(x,y) ©, 0) 
_ 
- mple 2.5 Show that the following functions are discontinuous at the given points 
(x, y) # (0, 0) — TS i) 
Gi) ear he x+y (x,y) # (0, 0) 





0. (4 y)=@,0) 0 , (xy) =@,0) 


at the point (0, 0). 


+ y)# (2, 2) 
, a (x y= 2, 2) 


= : } a = Vor) aes ! 
3 7 th - a7 whee fies i y ie x a 
f il yen ee age ag eat 
| 
_ 


¥ 
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‘ * a | i é t (Q) () 
. ganction ig not continuous af (VU, ()), 
the functio 


which depends on m. siege the limit does not exist, 


_» 0, Therefore, 
(ii) Choose the path y = m?x*. As (x, y) — (0, 0), We get x 


" (Le mye”. T= eh 
lim Ss Hall ng im ——— = +m 
(xyy)9(0,0) xy? y x90 (l+m ) Ss 
) action js not continuous at (0, 0). 
which depends on m. Since the limit does not exist, the function is not ) 


(x+y) (et D 


i es bag 1 A D9. 
(111) x, yD, 2) Fi, y) = an yum. 2) (x fe y) (x,y aM, 2) 


x nor ation ia not continuous at (2, 2). 
Since a yim, i f(x, y) # f(2, 2), the function 1s not con 


Note that the point (2, 2) is a point of removable discontinuity. 


f | ; 
Example 2.6 Let f(x,y) = eee (x;y) (0,0) 
4. #£ 0, (ay) =@,0). 
Find a 6 > 0 such that | f (x, y) ~/(0, 0)I < 0.01, whenever 
Solution We have 





If(x,y) -£@, 0) | = 


* 








Substituting x = r cos @, y = r sin 6, we obtain 
* 








If(%,y)-f0,0)1=]- 








-*3 Gl << 
ac SP as (ee) oa? x F er = a = 
a Te ee en ee ee fi Vote ae 5% J Mi fi 
3 f yo ‘ Lo ‘ i oa ' 
BPO NAb Dee See ye 
’ . et ST x 7) i “+ ’ i 
é ie iy | enn) s = fs a We ~ : 
5 I ~ 
: Ene 5) : 
- iy i 7. a FF: 





bee 








| Theref Poe J: : <¢ . 
i i= Ti O iT re e, - = zy y? 0.0 iF 5=0. i a an _ 
site oy ; va, . o ‘ ye ‘= 0.002. Hi ‘hkia, = é pels . Pte 
— Ps ‘ 7 . ‘ oe wilh a icnc la g,. ‘ »< 0.1 N JZ, a 
- U 


Y 
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Determine the following limits if they exist. 


| 3 3 
: v BM A 
7 — ' y 


lim fa 8 | ee ae 
: : im | 
(x.y) (0,0) |x? oh y? (x,yy>0,-1) w= ¥ 


” 





| 
lim [1 s 4 | 10 fie rs] ) : 
. Le 1m cot 
(x,y)—>(a,0) y (x, v)—(0,0) |x? + y? 


(y — 1) tan? x (x—1)siny 
11. im = ——————_.. i —_——- 
(ay )—(0,1) x? (y? ae L) 12. (z.9)-301,0) y In x 


l-x-y 


eis iy see 
(990.0) 2 4 y? oe eyo x? +y* 
3 42 
a 16k ne —— 
i 1 * v6 ‘ xY + a 
Me lim _ log} — |. 18. ar 
(x,¥,2)—(0,0,0) xy (x,y,2)9(0,0,0) 4 + y + ne 
yey! 
Gy , x(x +y+Z) 
(x,y,z) (0,0,0F yt + y* 4+ z8 (x,9,2)3(0,0,0) ¥- + yp" 47° 


Discuss the continuity ee the following functions at the given points. 


| rem +y*, (x,y) # (0,0) 


0 » (x,y) = (0, 0) 


(e- We 
Be Ha) 75,77 OYTO” 22. f(x,y) = 


- 


0 , (x, y) = (0, 0) 
at (0, 0). | at (0, 0). 








eel 





‘ys, ai 24. f(x, y= xy 
| eh 4 (es y) = (0, 0) 0 : (x, y) = (0, 0) 


at (0, 0). 


x* ~2xy+y? 


7 -, ary) # (0, 0) ’ (x, i ) oe 1G —l1) 


(x, y) = (0, 0) 


26. TUS y)= Mire 


ae 2 
0 ? (x, y) = (,-l) 





at (1, =1). 


PrN 


| eae (x, y) # (0, 0) 


0  (%, y= (;.0) 


28. f(x,y) = 


a 





» (x,y) #0, 0) 
yt ij eeu =i (0, 0) 





ius 


Te ae ate 1 | 
Pees 4 





7 oy =, 0) 





> 


I~ 
— 
tM 
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5 
[x?=¥ (x,y) 4 0,0) 
x*y? . oe x 2+y 
———_——_ X, = 0, 0 7 XxX; y) = s 
31, f(x,y) — x? of, y? ' (x y) ( ) 32 f( 0 (x, y) a (0, ()) 


0 , (hy) =@9 
at (0, 0) at (0, 9). 
x*y 
33. f(x,y) = 4 | +x’ 
y , (x,y) =CI, @) 


x#-1 


at (-1, a). 
XYZ 
———_——, (4, ),2) (0, 0, 0) 
34, F(x), 2) = D ii +y? +7" ( y 
0 (x,y,z) = ©, 0, 0) 
at (0, 0, 0). 
2xy 


———,, (x, y, z) # (0, 0, 0 
35. fies et x ae 37? ce y ) ( ) 

0 , (x,y,z) =, 0, 0) 
at (0, 0, 0). 


2.3 Partial Derivatives 


The derivative of a function of several variables with respect to one of the independent variables 
keeping all the other independent variables as constant is called the partial derivative of the function 
with respect to that variable. —— 
Consider the function of two variables z = f (x, y) defined i 
; 7 n some do _ ! 
Let y be held constant, say y = yo. Then, the functi main D of the x-y plane. 
an interval about x, that is f(x, yo) is a function of 0 


A, z=f(x+ Ax, yo) —f (x. Yo) 


is called the partial increment in z with respect to x 
s ok. and is a function of 
Similarly, if x Is held constant, say x = xo, then the fdueteg ae. of x and Ax, 
defined in some interval about y, that is f (xo, y) is a funct; noe rie ¥) depends only on y and is 
and (xo, y + Ay) be in D, where Ay is an increment in the independent varicty - Let the points (Xo, y) 
3 Variable y. Then 

Ayz=f (xo, y + Ay) — f (xo, y) : 

is called the partial increment in z with 


(2.10) 


(2.11) 







- This increment is called the total increment in z and 
nn vene ‘al, Az #2 ee 


Z+A. ZF is 
soa oe SXaMple, consider 


- es of x, y, Ax and Ay 
€ function 7 — 3 
On Z =F (x, y) = xy and a point (x, yo). 
A,z = (x + Ax) yo — X0Yo = yoAx 


~ ~ 


We have 


: . ‘ o ; 
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- ) | | 


Ayz=Xo(Yo + Ay) — xo yo = xg Ay 
Az = (x9 + Ax) Oo + Ay) — Xoo = XpAy + yoAy + AxAy # A,z+ Ayz 


Now, consider the limit 


lim A,z = fin f(%o + AX, Yo) — f (0; Yo) aa (2.13) 
Ax30 Ax Ax-0 Ax 


If this limit exists, then this limit is called the first order partial derivative of z or f (x, y) with respect 
to x at the point (xo, yo) and is denoted by z, (xp, Yo) Or f-(Xo, Yo) OF (OF /Ax) (xo, Yo) oF (9z/Ax) (Xo, Yo). 
Similarly, if the limit 


lim ByZ s. f(%0,¥o0 + Ay) — f (Xo, Yo) (2. 14) 
Ayo Ay 0 Ay 


exists, then this limit is called the first order partial derivative of z or f (x, y) wiih respect to y at the 
point (x9, yo) and is denoted by z, (xo, yo) or f,(%, Yo) or (dz /dy) (xo, Yo) or (OF [Ay) (Xo; Yo): 


Remark 4 
Let z = f (x, x2, - . ., x,) be a function of n variables defined in some domain D in IR”. Let 
Po(x}, X2, . - ., X,) be a point in D. If the limit 


i Ce CR ee 
Ax;j>0 Ax;  Axj20 Ax, 


exists, then it is called the partial derivative of f at the point Py and is denoted by (¢f/dx;) (Pp). 
Remark 5 


83.5 





| Ais a 


The definition of continuity, fim f(x, y) =f(%o, ¥q) can be written in alternate forms. Set 
x, ¥)>(x9, Yo 


X=Xx)+ Ax, y=yo+ Ay. Define Ap= ./(Ax)*+ (Ay)* . Then, Ax > 0, Ay > 0 implies that A p—> 0. 
We note that | Ax | < Ap and | Ay | < Ap. 
The above definition of continuity is equivalent to the following forms: 


(i) Jaa eee [ f(xo + Ax, yo + Ay) —f (x0, yo)) = 0. 


(ii) ah, [f(xo + Ax, yo + Ay) —f(%0, ¥o)] = 






(iii) lim, Az=0. 


we have 





eg et Oe) IY) 2, Ue + Ax)? + y? + (x + Ax) - [x2 +y? +2] 
~ Ox  Ax->0 Ax Ax—>0 Ax 
maa + 1)A+ (Ax)? 
fee Ax s arttg 2% + 14+ Ax] = 2241. 
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2 - 
2 —[x* +y + x] 
| 2 + Ay)” +21 | 
OF iy LE A F) e 
dy Ay 30 Ay Ay0 
Ay-0 Ay Ay-0 
= - Ax ee = 
oy Obie ti DE ae a, ee oye? li —  =— ye 
oe eee avo As 
Of lim i PAye = ye ee 
dy Ay30 Ay 


iti Of _ |, sin (2(x + Ax) + 3y) - sin(2x + 3y) _ ae cos(2x + 3y + Ax) sin Ax 
a dx , Ag=SO | Ax Ax-0 Ax 
= 2 cos(2x + 3y). 


Of 7 sin (2x + 3(y + Ay)) — sin (2x + 3y) 


2 cos (2x + 3y + 3Ay/2) sin (3 Ay/2) 
—= ili : = ha eeFeeeFSFSMMMMMMM—SSSSSS——— 
dy Ay—0 Ay 


Ay—-0 Ay 


sin (3 Ay/2) 


- sim, [3 cos (2x + 3y + 3Ay/2)] Gayl) = 3 cos (2x + 3y), 


Example 2.8 Show that the function 





, : l 
(x + y)sin : } x+y#0O0 
f(x,y) = wy : 
0 
is continuous at (0, 0) but its partial derivatives f, and 18 


Solution We have 
If we choose 6 < €/2, then 

|f (x, y)-O|<€ whenever Oc jx? Hye 5. 
Therefore, iy jim f(x,y) =0=f(0, 0). 


, xt+y=0 
do not exist at (0, OQ). 


| f(x,y) —f, 0) | = 








(x+y) sin{ 





S|x+y| <|x|+/y) < 24/x? tyrce. 





— (0,0) 
Hence, the given function is continuous at (0, 0). FD 
Now, at (0, 0), the limit Ky 
lim S22 = lim TAs) = F0,0) | lim AX sin (/ Ax) 
Ax>0 Ax Ax30 Ax agen . to = lim sin (4) 
does not exist. Therefore, the partial derivative f, does not exisee. 0, 0) Ax->0 Ax 
Similarly at (0, 0), the limit aS 


Ayz caf f (0, Ay) — f (O, 0) . 
ayo Ay 50 Ay ee 


tte ———— ———- 


Functions of Several Real Variables 249 


does not exist. Therefore, the partial derivative f, does not exist at (0, 0). 


Example 2.9 Show that the function 


0 
pea. =| Teh 409 
0 me ee y= (0, 0) 
is continuous at (0, 0) but its partial derivatives f, and f, do not exist at (0, 0). 


Solution We have 


x? +" 
[x}+ y| 


| 12 
eLiel tI Lei 4 [y| sayz? +y?<. 


|f(x,y) — (0, 0) | = oe 








Taking 6 < €/2, we find that 


| f(x, y)-0|<e, whenever 0< Jx* +y*< 6. 
f(x, y) = 0 =f (0, 9). 


Therefore, dun 
(x, ¥)— (0,0) 


Hence, the given function is continuous at (0, 0). 
Now, at (0, 0) we have 





| 1, when Ax > 0 
im et — tim £6429 -f0, Se ee -{ x 


Ax30 Ax  Ax230 Ax ~ Ax-—30 | Ax | —1, when Ax < 0. 


Hence, the limit does not exist. Therefore, f, does not exist at (0, 0). 
Also at (0, 0), the limit 


Ay f f (0, Ay) — f(0,9) _ in AY 1, when Ay > 0 
. lim = lin ————— im ——= | | 
—l, when Ay < 0 





Ay-0 Ay ~ Ay—0 Ay ~ Ay30 | Ay| 
does not exist. Therefore, f, does not exist at (0, 0). 


Examp| 10 Show that the function 


xy | 
| Se ee aes x, A ( ‘y 
Be ase ey ge 9) LO) 
_ nat : 0 sO, y) = (0, QO) 
$ not continuous at (0, 0) but its le derivatives hy and f, exist at (0, 0). 





2 
f( ey) A ee 
(x) jo, 0) u a (l+2m?)x? 1+2m? 
1 m, the function is not continuous at (0, 0). We now have 


pcmey a 
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700, Ay) = £00.0) _ jim 9=0 <0. 


———— 


fy, Q) = Aim, Ay dy7o0 Ay 


Therefore, the partial derivatives f, and fy exist at (0, 0) 


Piss erhtias -ondition for a function f (x, y) to 
| e Viti yr continuity) A sufficient con : | 
heorem 2.1 (Sufficient condition for bale Mey ‘vatives exists and is bounded 
+ eae at a point (xp, Yo) is that one of its first order partial derivatives 
- Hi ay | al bie ' r = ‘ 
in the neighborhood of (xo, Yo) and that the other exists at (%, Yo)- - 
, of tl oint (X%q, Yo) and 
Proof Let the partial derivative f, exist and be bounded in the neighborhood of the p 0» Yo) 


fy exist at (x9, Yo). Since fy exists at (xo, yo), we have 


lim f (xo, yo + AY) - f(%0+ Yo) _ ¢ (x5, yo). 
Ay-0 Ay 
Therefore, we can write 


| ZAS) 
f (xo, yo + Ay) —f (os Yo) = AY Fy o> Yo) + &1 AY (2.15) 


where €, depends on Ay and tends to zero as Ay — 0. Since f, exists in the neighborhood of (x9, yo), 
we can write using the Lagrange mean value theorem 


f (% + Ax, yo + Ay) —f (Xo, Yo + Ay) = Ax f, (Xo + 8 Ax, yo + Ay), O< O< 1. (2.16) 
Now, using Eqs. (2.15) and (2.16), we obtain 
f (x9 + Ax, yo + Ay) —f (Xo, Yo) = [f (xo + Ax, yo + Ay) —f (xo, yo + Ay)] + Lf Go, Yo + Ay) —Ff (Xo, Yo)] 

= Ax f,(%9 + OAx, yo + Ay) + Ay F(X, Yo) + & Ay. (2.17) 
Since f, is bounded in the neighborhood of the point (x9, yo), we obtain from Eg. (2.17) 
Ae tthees6 I(%0, 4x, yo + Ay) =f (x9, yo). 

Hence, the function f (x, y) is continuous at the point (Xo, yo). 
Geometrical interpretation of partial derivatives 


Let z= (x, y) represent a surface as shown in Fig. 2.3. Let the plane x = Xo = constant intersect the 
surface z = f (x, y) along the curve z = f (x, y). Let P(X, y, 0) be a particular point in the x-y plane 
and R(x, y, Z) be the corresponding point on the surface, where Z=f (Xo, y). Let Q(x, y + Ay Q) be 
4 point in the x-y plane in the neighborhood of P and S(%, y+ Ay, z+ A BR Aoi 


aks . z) be the corresponding point 
‘ce a: ve y). From Fig. Leds we find that Ay — PQ —_ RS’ ame the function Zz is increased 
a et Gye) —Z = Ayz. Now, let 0* be the angle which the ¢ R | it iti 

y-axis. Then from ARS ee oe & € chord RS makes with the positive 





tan @* = 55_ _ 


Ayz 
et Ay + 0. Then, A,z > 0. Hence, 


Ge. i 
aya tan @ 


— 
— 


5 
in —— 
Ay>0 Ay 
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where in the limit, 6 is the angle made by the tangent to the curve z =f (xo, y) at the point R(x, y, Z) 
on the surface z = f (x, y) with the positive y-axis. 


Z 





Fig. 2.3. Geometrical representation of partial derivatives. 


Now, consider the intersection of the plane y = yo = constant with the surface z = f (x, y). Following 
the similar procedure, we obtain dz/dx = tan @, where @ is the angle made by the tangent to the curve 
z = f (x, yo) at the point (x, yo, z) on the surface z = f (x, y) with the positive x-axis. 

It can be observed that this representation of partial derivatives is a direct extension of the one 


dimensional case. 


2.3.1 Total Differential and Differentiability 
Let a function of two variables z =f (x, y) be defined in some domain D in the x-y plane. Let P(x, y) 
be any point in D and (x + Ax, y + Ay) be a point in the neighborhood of (x, y), in D. Then, 

Az =f (x + Ax, y + Ay) -f (x, y) 


is called the total increment in z corresponding to the increments Ax in x and Ay in y. 
The function z = if (x; y) is od to be wa a at the aia (, y), if at this point Az can be 


vee Salve of te O° ie : KS A 


a] PA ‘ —) 


here 2 3, b are inde Banden of Te, A and E : = ax Ay), & = &(Ax, Ay) are infinitesimals and 
me fine 5 of Ax, Ay such that €; > 0, & — 0 as (Ax, Ay) — (0, 0). 


| Fey he first part a Ax + b Ay in Eq. (2.18) which is linear in Ax and Ay is called the total differential 
ors ing oly ‘the differential of z at the point (x, y) and is denoted by dz or df. That is 


dz=aAx+bAy or dz=adx+b dy, 





ae 









, 





% 
ee 
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Let Ay = 0 in Eq. (2.18). Then, Az = a Ax + €,Ax. Dividing by Ax and taking limits as Ax + ( 
we obtain a = 0z/dx. Similarly, letting Ax = 0 in Eq. (2.18), dividing by Ay and taking limits q. 
Ay — 0, we obtain b = 0z/dy. Therefore, 


igen 2 as =f, Ax +J,Ay (2.19) 
Ox dy 


assuming that the partial derivatives exist at P. Hence, 
Az=dz+ &Ax + &,Ay. 
a point P(x, y) is a necessary 





Therefore, existence o artial derivatives f, and f, at 


differentiabili ) Of f (x, y) at P. 


The second part €,Ax + €Ay is the infinitesimal nonlinear part and is of higher order relative to 


Ax, Ay or Ap= 4{(Ax)*+ (Ay)? . Note that (Ax, A y) — (0, 0) implies Ap — 0. Eq. (2.20) can be 


written as 
LAc) “(ae | ‘ eo Zp) - 


Now, if f (x, y) is differentiable, then as A p — 0, €; > 0 and & —> 0. 





Taking the limit as Ao > 0 in Eg. (2.21), we obtain 


mee on. ai( a} + | =( 799 
4p90 =AP Ap 50. | ' | Ap aN Ap } | (2.22) 


since | Ax/Ap| < 1 and | Ay/Ap| < 1. 





Therefore, to test differentiability at a point P(x, y), we can use either of the following two approaches. 


(i) Show that lim 42—% _ 9 . (2.23) 
Ap—0 Ap—» 2x) + Oy) 


(ii) Find the expressions for E\(Ax, Ay), &(Ax, A y) from Eq. (2.20) and 
Z., and lim & > 0Oas (Ax, A ) — (0, 0) or Ap > 0, 
NY Shou that” boll partial der C rie and ore te conhno ys ot uy) 
Note that the function f (x, y) may n SBE fiflerennable a a point P(x, y), even if the partial 
derivatives f., fy exist at P (see Example 2.12)~ Ht ever, if the first order Partial derivatives are 
continuous at the point P, then the function is differentiable at P. | 


We present this result in the following theorem. 


_- Theorem 2.2 (Sufficient condition for differentiability) If the fu 
~~ first order partial derivatives at a point P(x, y) in D, then F(x 


_ Proof Let P(x, 


then show that lim E, > 0 


Nnetion z = f (x, y) has continuous 
» ») is differentiable at P. 


y) be a fixed point in D, By the Lagrange mean value theorem, we have 
} EAS AE, We fH, Wx Mh £04 O,4x, 9), 0< 6, < | 
and I(x + Ax, y + Ay) —f (x + Ax, y)= Ay f(x + Ax, y + 0, Ay),0< 0, <1, 
Since f, and f, are continuous at (x, y), We can write 
Sx + OAx, y) = f.(x, y) + | 
fy(% + Ax, y + @,Ay) =f, (x, y) +e P 
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: ee _» 0, that is, 
where €, &2 are infinitesimals, are functions of Ax, Ay and tend to zero as Ax — 0, Ay 


as AP = (ax) (Ay)* > 0. Therefore, we have 


f(x+ Ax, y)-f(% y) =AxfiG y) + €, Ax (2.24) 
and f(x+ Ax, y+ Ay)-—f(w+ Ax, y)= Ay fy, y) + & Ay (2.25) 
Now, the total increment is given by 
Az=f (x + Ax, y+ Ay) —f(@ y) 
=[f(x+ Ax, y) —f (x, y)] + Cy a mgs —f (x + Ax, y)I. 
Using Eqs. (2.24) and (2.25), we obtain Sol 
(2.26) 


Az=f, Ax+f, Ay +& Ax + & Ay 
where the partial derivatives are evaluated at the point P(x, y). Hence, f (x, y) is differentiable at P. 
Remark 6 
(a) For a function of n variables z = f (x1, x2, . - -, Xn), we write the total differential as 
dz=f,,dx + fi, dea +... + fe, 4%n- (2.27) 


(b) Note that continuity of the first partial derivatives f, and f, at a point P is a sufficient condition 
for differentiability at P, that is, a function may be differentiable even if f, and f, are not 
continuous (Problem 5, Exercise 2.2). 


he conditions of Theorem 2.2 can be relaxed. It is sufficient that one of the art order partial 
derivatives is continuous at (xo, yo) and the other exists at (x9, yo). 


Example 2.11 Find the total differential of the following functions 


al y cil 

2 = tan”! (x/y), (x, y) # (O, 0), (il) = xz + x) ZF O, 
Solution . ; 

Sil) 7 l l y 
j : = tan ; atk ee | a | 
(i) f(x,y) n (=) fe fc (>| aye 
| / 2 J ce ee ee 

oo Sy Ty yy | A ay 


Therefore, we obtain the total differential as 


Sen a 
path 1) = ag de — 2 0). 


*.. y y-l 
(ii) f(x, y,z) = [xz + *) Sy = y( x2 + =) (2 es =| 
é Z 


° = , y 
ul 7 f.= i rife oe ‘a 
, ha(aet) (2+ 3) £-o(x+2)"(x-4) 
,, r 






Therefore, we obtain the total differential as 


J « (= + x)" o( rtd oft - Jr) ae| + +|(x +2) in [c+] |o 
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Example 2.12 Show that the function 


x? tay 


f(x,y) =35 x2 +y? 
0 , (x,y) = (0,9) 


, (x,y) # (0, 0) 


(i) 1S continuous at (0, 0), 
(ii) possesses partial derivatives f,(0, 0) and f, (0, 9), 
(if) 1s not differentiable at (0, 0). 
Solution 
(1) Letx=rcos @and y=rsin 0. We have 


|f(x, ¥) — f(0, 0) | = ee < r[|cos?@| +2] sin°A| J 


S3r= 3x7 +y7 <é. 


Taking 6 < €/3, we find that 


ae O|<é, whenever 0< ./x? +y°<6. 


Theref l 
erefore, 2 one 0) FCs, y)) = 0 = F(0; 0). 


Hence, f (x, y) is continuous at (O, 0). 


(i) f,(0, 0) = lim, Te lin Ax —0 


Ax>0 Ax =e 
F(0, Q) = lim FO, Ay) — = LO, O) lim 2 Ay — 0 Af. 


Ay 4550 9A y 

: Therefore, the partial derivatives f.(0, 0) and f,(0, 0) exist 

(ili) We have dz = Ax + 2Ay. Using Eq. (2.20), we get | 
Az= Ax +2Ay + E;Ax + &,Ay 


Let Ap= (Ax)? + (Ay)?. Now, 


neat 
x* 
<* 
ey eo) Az = f(Ax, Ay) — —- f(0, 0) = {Ax)" + 2(Ay)3 
A 2 
‘< Hence he ee 
Bees, 
= Az 
: 47 tim, — - lim —L | (4x)* + 2(ay)3 
ak | Ps 4p>0 Ap (4x)? + (Ay)? ~ (Ax + 24») oa 
Bee. # = lim - | Bed (ay + 2) 
s Ap 0 {(Ax)? 4 (Ay)2}372 


a 5a 
P>X A 
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Let Ax = 7 COS QO and Ay = rsin @. As (Ax, Ay) > (0, 0), Ap = r > 0 for arbitrary 9. Therefore, 
Az —dz 
| ee es : a) 
4p30 Ap Bm [cos @sin 0 (sin 8 + 2 cos O)| 
— [cos @sin O(sin 8 + 2 cos @)] | 
The limit depends on @ and does not tend to zero for arbitrary 8. Hence, the given function is not 
differentiable. Alternately, we can write 


Ae Me 1 | Arla s 2640)? Ay) 6 (44) 4 0,( 32] 
Ap Ap (Ax)? + (Ay)? ale 2p 
(Ay)? O( Any 
€) = — —_—__ So Smee Ne 
where 1 (An? + (Ay)? ape CAR)? = (Ay)? 


Substituting Ax =r cos 0, Ay = r sin @, we find that €, and €, depend on @ and do not tend to zero 
for arbitrary 9, inthe limit as r > 0. . 






Example 2.13 Show that the functien 


| xo ye 


/ Foe ple AL hy) 


Le 
O° Gy = 1) 
is continuous and differentiable at (1, —1). 


Solution We have 


2 2 
= y : 
Sa el xy) =0 =f (1, =1). 
(.y)>30,.-1) X-y ey we y) F( ) 
Therefore, the function is continuous at (1, —1). 


The partial derivatives are given by 













as ie | Aa | i 2 te 
£-0,- -1) =m, Ax ee Ax | 1 +Ax) +1 mL me a ey, 
Be srl + Ay )—f LD) 5) ee 
$,(.-1) = , lim a3 ayo Ay |T-Cl+4y) 9 |= 5A, 


Therefore, the first order partial derivatives exist at (1, —1). 

; Nov i WE aave 
eee CeO 0) ay ty? ey? 
Gay) aye. Gay 


Ai (x, y) = Ly (x, y) — le —]). 


Cx, y) # Cu. —1) 


y) 1 @= ay)? 
a fa spi 29) = (OD E=y)F ! piste 1) 
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the partial derivative /, is continuous at (1, —1). Also f,(1, —1) exists. Hence, f (x, y) is differentiah|, 


at (1, —-1), 
Alternately, we can show that eo [(Az — dz)/Ap] = 0. 


2.3.2 Approximation by Total Differentials 
From Theorem 2.2, we have for a function f (x, y) of two variables 
f (x + Ax, y + Ay) —f @, y) =f, Ax + f, ay 
or f (xt Ax, y + Ay) =f (x, y) +f, Ax +f, Ay (2.28) 


where the partial derivatives are evaluated at the given point (x, y). This result has applications jp 
estimating errors in calculations. 

Consider now a function of n variables x), x, . . ., x,. Let the function z = f(x), %,.. .. X,) be 
differentiable at the point P(x, x2, . . ., x,). Let there be errors Ax;, AX, ..., AX, in measuring the 
values of x), %2, . . ., x, respectively. Then, the computed value of z using the inexact values of the 
arguments will be obtained with an error 


Be fi Morty Ans... Am,) f(r, X, « + 5X). (2.29) 


When the errors Ax), Ax», . . ., Ax, are small in magnitude, we obtain (using the Remark 6 (a). 
Eq. (2.27)) 





Fy FAR, ty +AXs, . 2%, + AX) =f (X1, Xo, vey Xn) + fy, Any + fy, Axg +... t AX, (2:30) 


where the partial derivatives are evaluated at the point (x, %, ..., X,). This is the generalization of 
the result for functinns of two variables given in Eq. (2.28). 


Since the partial derivatives and errors in arguments can be both positive and negative, we define 
the absolute error as (using Eq. (2.29)) 


lAzl=ldzl=|dfl= ieee + fx, Ax Tien th Ae, 

Then, | df sil x | Ax, 1+|f,, in| Ax> [ a oe | Toe | | AS; |. (2.31) 
gives the maximum absolute error in z. If max | Ax; |< Ax, then we can write 

UaVS SA ie Us| + coe Lf 








The expression | ¢ 
percentage error. 





ai ae —-s ‘ J . : 
ae lice. oe ee 
relative 


e error and [| df\/| f 1] x 100 is called the 





The maximum relative error can also be written as 
































Wala fi |Ax, 1+ "sn 74) ae ie Snes on tl 
<| a2 tinisti|tax 14 aot in | f17 lA 20. 
’ ax an a Fin Lf} | 1 ry I 
“J ey ae , ; 
r _ Example 2.14 Find the total increment and the total differential of the function z = x + y + x) 


¥ at the point (1, 2) for Ax = 0.1 and Ay = 


— 0.2. Find the maximum absolut | 
_ relative error. Olute error and the maximum 
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Solution We are given that f (x, y)=x+y4 xy; (x; y) = (1, 2). 
therefore, f (1, 2)=5, f,(1, 2) =3, £,(1, 2) =2. We have 
total increment = f (x + Ax, y + Ay) — f (x, y) 
= [(x + Ax) + (y + Ay) + (x + Ax) (y + Ay)] —[x t+ y + xy] 
= Ax+ Ay+x Ay+yAx+ Ax Ay. 
At the point (1, 2) with Ax = 0.1 and Ay = — 0.2, we obtain 
total increment = 0.1 — 0.2 + 1(—0.2) + 2(0.1) + (0.1) (- 0.2) =-— 0.12 
total differential = PALL, QV As + f,01, 2) Ay = 3(0.1) + (2) (0.2) = -0.1 


maximum absolute error = af \= of | | Ax | + 
: 





of | | Ay | = 3(0.1) + 2(0.2) = 0.7 
dy 


maximum relative error ia = md) Bt ee \ 


Example 2.15 Using differentials, And an approximate value of 


(i) f (4.1, 4.9), where f (x, y) = x3 + xy. 
(ii) f (2.1, DL) where f (x, y) = x, (log 2= 0.3010). 
Solution 


Me Let (x, y) =(4, 5), Ax = 0.1, Ay = — 0.1. We have 


: 3 
GGy)= 4x? +x7y, fG,5)=12, f(y) = pe F2(4;5)= *, 


oe +x*y 


2 | 
—_*__., f, (4,5) = 4 
Dalx? + xy 












| =12+4 (3) (0.1) + (3 (-0.1) = 12.3. 
J eis: J (4.1, 4.9) = 12.3. 


ee Ok , Ay = 0.2. We have 


> & 





iz? 
. ’ 
ee ' 7 i] 


“? ; 


‘" Sis 
=@ 

* 

@ 


me: 
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Therefore, f(21, 3.2) =/ (2, 3) 40, 3) Axct f, (2, 3) Ay 
= 8 + 12(0.1) + (2.408) (0.2) = 9.6816. 

The exact value is f (2.1, 3.2) = 10.7424. 
Example 2.16 Find the percentage error in the computed area of an ellipse when an error of 2% 
made in measuring the major and minor axes. 2+). 
Solution Let the major and minor axes of the ellipse be 2a and 2b respectively. The errors Aa ay 
Ab in computing the lengths of the semi major and minor axes are 

Aa = a(0 02) = 0.02 a and Ab = B(0.02) = 0.02 b. 


The area of the ellipse is given by A = 2 ab. Therefore, we have the following: 
Maximum absolute error in computing the area of ellipse is 
| Aa | + 


_| 9A 
|dA|= da 





i | | Ab | = 1b(0.02a) + 2a(0.02b) = 0.04 rab. 








Maximum relative error is 


| a = (0.04 mab) = 0.04. 


aS 
Tab 


Percentage error = | wt | x 100 = 4%. 


‘3.3 Derivatives of Composite and Implicit Functions (Chain Rule) 


Let z= f(x, y) be a function of two independent variables x and y. Suppose that x and y are themselve: 
functions of some independent variable t, say x= O(t), y= W(t). Then, z= F{O(), w(2)] is a composit 
function of the independent variable t. Now, assume that the partial derivatives f f, are continuou: 
functions of x, y and @(t), w(t) are differentiable functions of f. aa. 


Let Ax, Ay and Az be the increments respectively in x, y and z colresponding to the increment A! 
in t. Then we have 


of of 
Aree a Ay + & Ax + Ey Ay. 


Dividing both sides by At, we get 
Az _ of Ax of Ay Ax A 
—ae y (Q 
At Ox At” dy At Te Ag 12 Ar 2-42) 
Now as At 0; Ax 40, Ay 0 and E| = => 0.25 
| t - | 


Ay | 
e Ga — 0. Therefore, taking limits on both 
sides in Eq. (2.32) as At — 0, we obtain : 


: a _ of dx | Of dy | 
dt dx dt aah ate (2.33) 


ew let x and y be functions of two independent variables uv and VU, Say xX = O(u, Vv), y = Wu, V). 


n,Z=f[d(u,v), Wu, v )] isa composite function of two independent variables u and v. Assume 
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that the functions f (x; y), @(u, v), w(u, v) have continuous partial derivatives with respect to 

their arguments. Now, consider v as a constant and give an increment Au to u. Let A,x and A,y 

be the corresponding increments in x and y. Then, the increment Az in z is given by (using 
Eq. (2.23)) 














Az= Za, r+ Ts ny + €;4,x + E2 Avy 
where €,, € > O as Au > 0. 
Dividing both sides by Au, we get 
= _ Ff Aim , Of Ay. ae AUX Auy (2.34) 
~ Ox Au dy Au Au 


Taking limits on both sides in Eq. (2.34) as Au — 0, we obtain 


oz _ Of ax , Of oy (2.35) 
Ou ox du dy Ou 
Similarly, keeping u as constant and varying v, we obtain 


dz _ of Ox Of dy 
oh ey 2.36 
do ax ov dy OD = 


The rules given in Eqs. (2.35) and (2.36) are called the chain rules. These rules can be easily extended 
to a function of n variables z = f (x;, Xo, - - ., X,). If the partial derivatives of f with respect to all its 
arguments are continuous and x), x2, . . ., x, are differentiable functions of some independent variable 
t, then 








(2.37) 


Example 2.17 Find df/dt at t = 0, where 

(i) f (x, y) =x cos y + e*siny,x=t?+1l,y=t? +t. 

(ii) f(x, y, ax txert+y +xyZx=e, y= Cost, z= £3. 
Solution 


(i) When t = 0, we get x = 1, y = 0. Using the chain rule, we obtain 


df _ of dx me of dy 

Geo On dt oy at 
Substituting t = 0, x = 1 and y = 0, we obtain (df/dt) = e. 

(ii) When t = 0 , we get x = 1, y= 1, z= 0. Using the chain rule, we obtain 


ase _ of dx , of dy | of dz 
max at oy at dz at 


= (cos y + e* sin y) (2t) + (-x sin y + e* cos y) (317 + 1). 


: = (3x7 + z* + yz)(e’) + (3y? + xz) (— sin t) + (2xz + xy) (37). 
he ‘Substituting t = O,x= 1. = 1; a 0, we obtain (df/dt) =3 





> - ® ie 
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Example 2.18 If z=f (x, y),x=e“+ 6, yao 4 e*”, then show that 


ee 72| Ld z| 


du ou dx By 
Solution Using the chain rule, we obtain 


of _ Of ax of dy _ 95m OF yn 2u Of 


du doxdu dydu ~ ox dy 
Therefore, of - of = 2(e7" +e?) of —2(e™ + ?”) 


: ps of variables 


Suppose that f (x, y) is a function of two independent variables x, y and x, y are functions of two new 
independent variables u, v given by x = O(u, v), y= w(u, v). By chain rule, we have 


of _ of dx | Of dy and of of ox Of oy 
du Ox du dy du dv dx dv dy du 
We want to determine df/0x, df/dy in terms of df/du and of /dv. Solving the above system of equations 
by Cramer’s rule, we get 
Of ldx = of /dy i 1] 
Of dy of dy Of dx Of ax ax ay dx dy 


eS cee —————_— oe SO eee 


du dv dvudu odvdu odudv. du Ov dv Ou 
The determinant 
|ax/du ax/dv] a(x, y) 
dy/du dy/dv| (u,v) 
is called the Jacobian of the variables of transformation. Similarly, We write 
Of dy of dy _Of,y) |Of/du  daf/av 
du dv Ov du u,v) ~ dy/du  — dy/dv 














du dv du du O(u,v) 











| Of dx Of Ox A(x,f) |dx/du  ax/dv O( f, x) 
and =~ 5 > = SS ee 
dv du du dv Au,v) Of/du  daf/av O(u,v) - 
Hence, we obtain 
of _1[Of,y)] Cs  WOCh.x) (2.38) 
ox ES “4 ey OY se va 


Similarly, if f (x, y, z) is a function of three independent variables x, y, z and x, y, z are functions of 
three new independent variables u, v, w given by x = F(u, v, w), y = G(u, v, w), z = H(u, v, w), then 
_ by chain rule, we have 


a 
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cok’ 
so? Of of. of Or oh of dy aor oe 
4 oO du dx du dy du Oz Ou 


Of _ Of dx , Of oy | Of daz 


— 


dv dx du dy du dz ov 
of | Of dx , Of oy , OF dz 
Ow dx dw dy dw dz dw 


Solving the above system of equations by Cramer’s rule, we get 


ofldu af/av  af/aw 
=+)ay/au ady/av  day/aw 


of _ 1 | Of. 9,2) 
ax J | O(av,w) | J 
dz/du dz/dv  dz/ldw 


afldu ofldv dof /aw 
5 7 seh). ppseuiuass) ae ae dx/du odx/dv  adx/dw 
dy J | d(u,v, w) J | O(u,v, w). gee 

Oz/du dz/dv  dz/dw. 


5 - 5 Of/du odfldv  odfldw 

bl = Bp deD) | ie) Sik dx/du dx/dv  dx/dw (2.39) 
J | d(u, v, w)_ | A(u,v,w) | J ) 

dy/du dy/dv  dy/dw 


AOx/du dx/dv  dx/dw 
where J=|dy/du  dyldv  dy/dw 

dz/du dz/dv = az/dw 
is the Jacobian of the variable ansformation. 


Example 2.19 If z=/ (x, y),x =r cos 0, y =r sin 6, then show that 


of f of\* 1 far? 
(z) (¥) (3) (35) 


Solution The variables of transformation are r and @. We have 





dx/dr  odx/d0 


_|cos@ -—-rsin@ 
~lay/ar ay/d0| 














sin @ rcos @ 











acf.y) _|ef/or  af/oe ; _|af/ar — afiae af 3 
d(r,9) |dy/dr dy/d0 sin@ rcos@ 5, ~ Sin Gan 56 
_ | flor of/de : Of/dr odf/de of of 
| dx/dr 0x/00 / cos 6 —rsin @ =-—rsin@ ar — cos Oa. 














» y 
e : 
7 ‘a = ‘ad a t aa ' 
ic. ¥ i wil 1 ' 1 yo a ‘ 38), we obtain 
a i ae =. yy be a : 
7 " 
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of - 4) 34 3) - cos Ooo. sin @ Of 
J 








ox d(r, 8) or rr 00 
Of O(f, x) ~ AF . cosO OF 
aera | mS a ar BO 


Squaring and adding, we obtain the required result. 


Example 2.20 If u=/f (x, y, z) andx=rsin @cos @, Mie sin @sin @, z =rcos G, then show tha 


of) (a) , (a (ery 2 (ar l (xy 
(XY «(2 +2) +B AB) ate 


Solution The variables of transformation are r, @ and @. We have 





| sin 8cos ) rcos @cos Wy) —rsin @sin 0 
— 9%, Ys Z) =|sin@sing rcos@sing@ rsin@cos@ |=r7sin @ 
O(r,0,@) | 
cos @ —rsin@ Q 
of /dr of/d0@ df /d@ 
OF, ¥» 2) vue) sin@sing rcos@sing@  rsin @cos @ 
a(r, 0, o) 0,0) 
cos @ —rsin @ 0 
= r* sin?@cos off + rsin @cos @cos oe —rsin @ io 
Of /dr of/de of/dd 
of, ATES), sin 8 co : 
S@ rcos@cos@ -rsin Osin wv) 
a(r, 6, o) 0,0) . 
| @os @ —rsin @ 0 
= —r* sin?@sin of —rsin @cos @sin oof —rcos ov 
: Of /dr df /d@ of/dd 
Af aay)! | | 
noe. sin@cos@ rcos @cos @ -—rsin @sin @ 
sin@sing rcos@sing  rsin Ocos @ 
a of a OF 
— : —_— 2 ee 
r SI ELOS 0 -=<- r sin O=-. 


Using Eq. (2.39), we obtain 
Of _ 7 eee |- Cats: of cos Ocos @ OF Tsim sing of 
r 








ox A(r, 0, d) 06 ~=rsinO ao 
Of _ O(f, x, z) ae cos Osin @ Cae co 6 
dy aback eee eo of 5 
Of O(f, x,y) _ _ sing of 
az | 3 0, | - et rE Oey 


____ Squaring and adding, we obtain the We result. 
i 
as 
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b alien of implicit functions 


The function f (x, y) = 0 defines implicitly a function y = @(x) of one independent variable, x. Then, 
we can determine dy/dx using the chain rule. From f (x, y) = 0, we get 


# 2 Of 4 BE of dy _ 
~ Ox dy dx 
dy _ f(x,y) 
or | oe ~ fy y) (x. yy’ Fy (%Y) = 0. (2.40) 


The function f (x, y, z) = 0 defines one of the variables x, y, z implicitly in terms of the other two 
variables. Using differentials, we obtain 











t= Fdx+ Lay 4 L dz = 0. (2.41) 
If we take y = constant, then dy = 0 and we get from Eq. (2.41) 
of of dz\ _  (df/dx) 
> dx + > dz=0) ‘or ( #e ; = EER (2.42) 
If we take x = constant, then dx = 0 and we get from Eq. (2.41) 
= on - 43 
a Pc —dz=0, or er (aflay) (2.43) 
If we take z = constant, then dz = 0 and we get from Eq. (2.41) 
Of ech dx\ _  (df/dy) 
oe dx + — By dy = 0, or SE) SS aPTOx) (2.44) 


Multiplying Eqs. (2.42), (2.43) and (2.44), we obtain 


dx dy | ax) ( dy dz) | 
cal ral Fall _— BA al eal = (2.45) 
Example 2.21 Find dy/dx, when 


2 
¥ = 
(i) flx,y) = 4 + 2-1-0. 


a) f(x y) = In(x2 + y’) + tan7!(y/x) = 0. 





of _ 2x and of _ 2y 


=—-—_—- 


ax a? | dy b2" 


Colne Oflox _ 1 b2x 
Bee tone, ay 27” 


Seat Le a0 (| 
TT 4 y2/x2 ( 4 










ee J ek 2K = y 
x? + y? x? +y x2 +? 
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| ZY +5 
dy xy? 1 4ytle? (so eart Natnghe ep) Sere YS: 


: 1y Of / dd 2x - y-2x 
Therefore, dy a if lox - ie Tay 


dx of/fdy 2y+x 








x 
Der are 


Exercises 2.2 
1. Show that the function 


od 


F(xy)=4 fx? +y2- 


0 Ge y= «0, 0) 
has partial derivatives f, (0, 0), f, (0, 0), but the partial derivatives are not continuous at (0, 0). 
2. Show that the function 


(x, y) ca (0, 0) 


2 2 
| eee a (x,y) # (0, Q) 
f(x,yJ= 4 *-y 
0 , (%,y) = (0, 0) 
possesses partial derivatives at (0, 0), though it is not continuous at (0, 0). 
3. For the function 
y(x* —y?) 
FOQsINRS pe? gy?” Es 
0 » (x,y) = (0,0) 
compute /,(0, y), f,(x, 0), f.(0, 0) and f, (0, 0), if they exist. 


4. Show that the function (HESS) een y2 is not differentiable at (O, 0). 
5. Show that the function 





f(x,y) = 


(x? +y*) cos | —_1__ > \(X,¥) (0, 0) 
x* + y? 


0 » (x,y) = (0, 0) 
are not continuous at (0, Q). 
Find the first order partial derivatives for the following functions at the 


is differentiable at (0, 0) and that Deady Does this result contradict Theorem 2.2? 


specified point: 
| 7. f(x, y) = In(x/y) at (2, 3). 
8. f(x, y)=x*e"” at (4, 2). 9 f(x,y) = x/afx? + y? “at 6; 7). 


10. f (x, y) = cor (x+y) at (1, 2). 11. f(x, y) = In Fone at (3, 4). 


x? +y2 4% 


6. f (x, y) =x* — x2y? + y* at (—1, 1). 


tte CY, 2) (x? + 5? 427)-12 (QeT ay 
“Ki 


13. f (x, y, z) = e*) 4 ez! ae, 1,23, 
J ; MP Rie oy yee ary) Sin : +s . . : 
eit f (x, Y, 2) = (xy) * at (3, 5, 27/2). 13. f Gy 2) =In (x+ Sy? +22) at (2, 3, 4). 





ws 


ee — eee tti(“‘i‘<i— SO 
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Find dw/dt in the following problems. 

16. wart y,x=(?- it, y= (2 + 1) atta 1. 

“47, wart y* + 2°, xX = cos y=In(t+1),z=e' atr=0. 

18. w=e* sin (y+ 22), x=t, y=1/t,z= 7. 19. waxyt yet myx, yale, Zale’. 
AQ. w=ziny+y Inz+xyz,x=sint,y=Pr+ l,z=cos t att=0. 


Verify the given results in the following problems: 


21. Ifz=/ (ax + by), then oe a oe 10} 
Ox dy 
ain [(x* — y”)/(x? + y?)], then rays 0. 
y 
Ps Ifu=f(a%-y, y-—z, z—x), then UES UG 
| ax dy dz 


24. If z=f (x, y), x =rcosh 6, y=rsinh @, then 
az)" _( a2)" _(8) _ 4 ( 22)" 
ax} “Wey a Ver r2 \ 00) 
| x OZ 
25. Ifiz=y +f (wu), as then baaitan Hu 


26. Ifw=f (u,v), u= fx? +y2 ,v = cot (y/x), then 


(2%) + sole) +3} 


27. lfz=f (x, y), x =u cos M—-v sin a, y=u sin @+ v cos G, where @ is a constant, then 


ee 


az az 
2B. Ifz=In(u2+0v), u=e**”, v=x+y’, then ay 


Beit w= x? +y? 477 ,x=uUcosvU, y=U SiN DV, z= uD, then 


ow Ow _ u 


wom -— UD 


Ou Ov See. : 


307 Tf w = sin” “uae t+y? +z7)/@+y +2), then 
Ow aw ow 
a, y——'+ Zz —— = tan w. 


Y Oy dz 
Using implicit differentiation, obtain the iets 


OL, 2, when x’ + y* = G, @ any constant, x > 0, y > 0. 
= pa =. when cot” (x/y)+y° + 1=0,x>0,y>0. 
ate, se 


33. [ a2) ind cand ($) , when Cos xy + cos yz + cos zx = 1, 
eek ax), oy), 
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34. 


35. 
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a 


Ox Ox | 28) 
(BB, m 58) 


ss) and a , when x + 3xy —2y? + 3xz+ 2° =0. 
dx) dy 


Using differentials, obtain the approximate values of the following quantities: 


36. 4/(298)? + (401)? . 37. (4.05)! (7.97). 
=. a ee ae 

38. cos 44° sin 32°. 39. Vis + 307 + J9.01 

40. sin 26° cos 57° tan 48°. 

41. A certain function z =f (x, y) has values f (2, 3) = 5, f,(2, 3) =3 and f, (2, 3) = 7. Find.an approximate 
value of f (1. 98, 3.01). 

42. The radius r and the height h of a conical tank increases at the rate of (dr/dt) = 0.2°/hr and 
(dh/dt) = 0.1"/hr. Find the rate of increase dV/dt in volume V when the radius is 5 feet and the height 
is 20 feet. 

43. The dimensions of a rectangular block of wood are 60”, 80” and 100” with possible absolute error of 3” 
in each measurement. Find the maximum absolute error and the percentage error in the surface area. 

44 


45. 


46. 


47. 


49. 


50. 


2.4 


Let z = f (x, y) be a function of two variable 


points 


functions of x and y. We define the seco 
\ 


- Two sides of a triangle are measured as 5 cm and 3 cm and the included angle as 30°. If the possible 


absolute errors are 0.2 cm in measuring the sides and 1° in the angle, then find the percentage error in 
the computed area of the triangle. 


The sides of a rectangular box are found to be a feet, 6 feet and c feet with a possible error of 1% in 


magnitude in each of the measurements. Find the percentage error in the volume of the box caused by 
the errors in individual measurements. 


The diameter and the altitude of a can in the shape of a right circular cylinder are measured as 6 cm and 
8 cm respectively. The maximum absolute error in each measurement is 


| 0.2 cm. Find the maximum 
absolute error and the percentage error in the computed value of the volu 


me. 
The power consumed in an electric resistor is given by 
K = 5 Ohms, by how much the power consumption will c 
decreased by 0.1 Ohms. 


If two resistors with resistence R, and Ry in Ohms are connected in parallel, then the 
resulting circuit is R = [(1/R,) + (1/R3)]"'. Find an approximate value 
resistence that results by changing R, from 2 to 1.9 Ohms and R> 


from 6 to 6.2 Ohms. 
Suppose that u = xze” and x, y, z can be measured with 


ae = . maximum absolute errors 0,1, 0.2 and 0.3 
respectively. Find the percentage error in the computed value of u from the measured values x = 3; 
y=In2 andz=5. , 


P = E’/R (in watts). If E = 80 volts and 
hange if E is increased by 3 volts and R is 


resistence of the 
of the percentage change in 


If the radius r and the altitude A of acone are measured with an absolute error of 1% in each measurement, 
then find the approximate percentage chan 


ge in the lateral area of the cone i | lues are 
r= 3 feet and h = 4 feet. € cone if the measured valu 


Higher Order Partial Derivatives 


S and let its first order partial derivatives exist at all the 
e function f. Then, the first order partial derivatives are also 
nd order partial derivatives as 


in the domain of definition D of th 


a 
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oF 19 fof . i ; 
Set oe | |= fon 9) = sim f paceeeo vec) 
*f _ a | of SLI pe 
Oy Ox 7 oy | = S yx (xX; y) = ee sty REY 


(differentiate partially first 


eo. J 
dcau oy an =I (x, 


(differentiate aie first 


of 2 (x, Ay) - ; 
dy? ~ Oy aE aE =fyy (x,y) = fim agen Fea 
Ves aie 





point F(x, y), then at this point f,, = 
case. Th ere are (out partial derivatives 





“a the TMS exist. The derivatives ry and f,, arc RY mixec 


= f,x« That is, the order of differentiation material in ris 
of second order for f (x, y). If all the second order partial 


with respect to x and then with respect to y) 


i [pele EE Nata 
os a Ax | 


with respect to y and then with respect to x) 






| derivatives. T fry ANG fyy é i are 


derivatives exist at all points in D, then these derivatives are also functions of x and y and can be 


further differentiated. 


as 


Solution We have 


2.22 Find all the second order partial derivatives of the function 
f (x, y) = In(x? + y*) + tan7! (y/x), (x, y) # (0, 0). 


= I y 2x = 
Bes yee 
4 + y ] + (y/x)? x ieee y- 
2y l a 
x, aa —|= 
Jy ( > 2 ye + ae (4 ie + y? 


Syx (x, y)= cs (fy -2(755 aaa 


mls 


ae 


re SONI 


=———— 


fiy(*,y) = Ox 


2 (fy) 





Cx + y*) (-1) — (2x - y) (2y) 


es + yee 


jee — x2 - Axy 
(x* + y?)? 


y? 


(x° +97)? 


(x* + y*) (1) — (2y + x) (2x) 


= ee aa 
(x? + y?)? 


—x* —4xy 


= 


2x-y ) _ (*+y7)@)-Qx-y) 2x) 2y? ~2x2 42 
xx = x x wiih = as oa 
£ (x, y= = (f ae 2 =%,) - (x? + y*)? (x? + y2)2 
- jee. 0. | 2 ex (x* + y*)(2)-(2y+x)(2y) 2x2 — L. 
iat OY) _ 2x0 — Dy? = Dy 
. ”y yo Oy ex? Fy? (x* + y2)2 (x? ty?) 
We note that tay = Sox: 
Exan | le 2.23 For the function 
xy(2x* — 3y?) 
f(x,y) = a ay? a! (x, y) # (0, 0) 
0 





Show that fy (0, 0) # yx (0, 0). 


. 


> (x, y) = (0, 0) 
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Solution We obtain the required derivatives as 


fx (0, 0) = GAR 0, fy (0, 0) = Jim, ae =( 
f,(x.0) = jim, Hai 1) = Jim, peer 22%. 
Now, 
hiv. m= FF) SE ee Jim, 2Ar — 0 —_ 
fy 0, 0) = = Eee = lim, (ae = Jim, = ei 


Hence, f,, (0, 0) # f,, (0, 0). 
Example 2.24 Compute fry (0, 0) and fyx (0, 0) for the function 
5.2 
a re 
0” » (x,y) = (0, 0). 
Also discuss the continuity of fry and f,, at (0, 0). , 
Solution We have 


—_ Iz f (Ax, 0) — f(0, 0) : ) Lees . 
BOO = lin = 0, Fy (0, 0) = Jim LOO) = F0.0) _ 9 


Ay 
Bry tot SOE POY = in er 
Ax Ax—0 [Ax + y? ] Ax — 
fy(x,0) = fim, FAL) iggy 249)? 
y Ay 0 [x + (Ay)?] Ay 
fy. = fim, 26°) F0.0) | 
Ax 


| ~ pr Sx, Ay) — f, (0,0 
Fyx (0, O) = aim, So im Ay 


Since f,,(0, 0) # Fyx(0, 0), fy and fx are not continuous at (0, 0). 
Alternative We find that for (x, y) # (0, 0) 


y +5 
Syn (%, tas. ee = Pey (Xs ¥). 
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Along the path x = my’, we obtain 
y(t om) 2 1+ Sm 
(2,y 0) Fox 2 9 = Me y°(1 +m)? ~ (Ll+m)>- 
Since the limit does not exist, f,, is not continuous at (0, 0). 


Example 2.25 For the implicit function f(x, y) = 0 of one independent variable x, obtain 
y= d*y/dx*. Assume that Try = Lx: 


Solution Taking the differential of f (x, y) = 0, we obtain : ee ok, -2 
{= dy | Ix 
ae ae Ai 
Therefore, 
dy _ afd pt) ft) -f EH) 
“ -£|9|-- aban f2 = 
= Ty life + (Son =Selicy + Cy )y ] 
ie | 


Substituting y’ = —f,/f,, we obtain 
d*y Te des = Dike Sy Say + fe Te 


SS SS Lo Le Le fae ee since = : 
dx* 1 Fyx yy 


2.4.1 Hemegeneous Functiens 


A function f (x, y) is said to be homogeneous of degree n in x and y, if it can be written in beny 
one of the following forms , 
pees Pee FOMOWE 

4 


DFGxAy) =a" fin TALI ( T™ my (2.46) 
(ii) f (x, y) =x" g(y/x) - a SE ue (2.47) 
(iii) f (x, y) = y" g(x/y). Nol Awe’ x | (2.48) 

Similarly, a function f (x, y, z) of three variables is said to be homogeneous. of degree n, if it can be 


written as f (Ax, Ay, Az) =A" (x, y, 2), or f(x, y, Zz) = s"e( 2 2) etc. 


Some examples of homogeneous functions are the following: 





f | | degree of homogeneity 
x? + xy 2 
tan“! (y/x) 0 
I/(x + y) —] 


Wet + y' 42°) 4 
tgs er +2) 3 


—1/2 





“90 Engineering Mathematics 


The function f (x, y) = (x? + y)/(x + y?) is not homogeneous. 


An important result concerning homogeneous functions is the following. 


Theorem 2.4 (Euler’s theorem) If f(x, y) is a homogeneous function of degree n in x and yandh 
continuous first and second order partial derivatives, then 





0 id 
(i) x Sy ao = rf. (2.4! 
O° f Conia 2 et ee 2.5 
| *@ ; Ps be —= —_ —— ii 4 2. 
(ii) x 2 + 2xy XY a sa 7 =a(n— lf (2.51 


Proof Since f(x, y) is a homogeneous function of degree n in x and y, we can wri 
f(x, y) = x"g(y/x). 
Differentiating partially with respect to x and y, we get 


0 | ¥ il= N= f y 
— meri 2 +x"9 (2 (-] = nx (2 2) — yx “8 (2). 
of Rial ok | _— «hl 2s J. 

y =2'8(2) (4) = (3): 


Hence, we obtain 


] 0 | | 
roy = mete (2) -aerte{2) eomte(2) = mete 2) =o 


Differentiating Eq. (2.49) partially with respect to x and y, we get 


pot of Oe. of um 
PGEe 00x *” Gna, "oy ee 


af or ee of oe. 
“@ydx dy *? ay?” ay’ aie 


Multiplying Eq. a. 51) by x and Eq. (2.52) by y and adding, we obtain 


oy of of a*f orF 0? | : 
PS | LG G] @] 
ax2 +(: ra ty] ty oak eh). "3p n(x Fay X 


and 





: oo oof O*f Our 
or | i, 
A lege dy Yar =Mn— DS. 


xX + 
Example 2.26 If u(x, y) = cos~ (ze on: nesta O<x, y< 1, then prove that 


) 
tty ses 5 cot u. 


pervtion For all x, yO x, yrs], (x ‘ig yf Vx + Vy] < 1, so that u(x, y) is defined. The given 





ion can be written as 
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Conn = x[1 + y/x] E/E 1 + (y/x) 
1+ «/y/x 


Vx+Jfy Vx [1+ f/x] 
Therefore, cos u is a homogeneous function of degree 1/2. Using the Euler’s theorem for f= cos u and 


y = 1/2, we obtain 


x (cos u) + YF (cos u) = 5 COS 1 


Ou Ou ] Ou du ] 
| =e S : —_— [ i | i r SS — — _—— ier | * 
or (sin u) = y (sin uv) Jy = 7 COS Ms or x a as 5 cot u 


Example 2.27 If u(x, y) = x* tan“! (y/x) - y’ tan! (x/y), x > 0, y > 0, then evaluate 








2 07u 07u 2 0*u 
x? == + 
AS ey Pe 
Solution We have u(Ax, Ay) = A*u(x, y). Therefore, u(x, y) is a homogeneous function of degree 2. 
Using Theorem 2.4 (ii) for f= u and n = 2, we obtain 


OP its) selOLwll_aneo) ayes 
BE OU ue. Saal l)u = 2u. 


Example 2.28 Let u(x, y) = [x° + y*]/[x + y], (x, y) # (O, QO). Then evaluate 


07u d*u du 
axe ex Oy. Ox. 
*[1 + (y/x)? 
Solution We have u(x, y) = Sree Therefore, u(x, y) is a homogeneous function of 
degree 2. Using Euler’s theorem, we get _ 





2 
x £8 42m 


xX 





Ou Ou _ 
xa ar = 2. 


Differentiating partially with respect to x, we obtain 





Ou Oru O*u _ 9 du or Ofu O“u 2on 
see. exe OXOR, ON ~ on oid 
Example 2.29 Let f(x, y) and g(x, y) be two homogeneous functions of degree m and n respectively 
oh |. Oh 


where m # 0. Leth=f+ 8. If eS 0, then show that f= @g for some scalar a 


Solution Since f and g are homogencous functions of degrees m and n respectively, we obtain on 
using Euler’s theorem 


CS eae ia 98 | Og 
eS a and Pee oy TE 


_ Adding the two results, we get 


of | 9g’ of a 
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or x Oh, y Oh mp ng =0, where h=f+ g. 
Ox dy 
Therefore/ f= — ~ 9 = ag, where a= — — isa scalar. 
lere Ores f=- 7 b= 2&8, whe zs 
2.4.Y Taylor’s Theorem 





1 section 1.3.6 we have derived the Taylor’s theorem in one variable. If f (x) has continuc 
derivatives upto (nm + 1)th order in some interval containing x = a, then 


f(x) =f (a) + (x-a) f’(a)+...4+ (5-3) 60(a) + R, (x) (2.! 


where R,(x) is the remainder term given by 


Ry (x) = FOO pone 6) = FAO praevia g O(x-a)],a<&<x,0<0<1. (25 


We now extend this theorem to functions of two variables. 


Theorem 2.5 (Taylor’s theorem) Let a function f (x, y) defined in some domain D in R?* ha 
continuous partial derivatives upto (n + 1)th order in some neighborhood of a point P(xp, yo) in ! 
Then, for some point (xg + A, yo + k) in this neighborhood, we have 


F (% +h, yo + k) =f (x9, yo) + Ge + t2) F020.90) “ n(r2 + Ke) f(%o, yo) 





ii(pecGimert)” gene es 
tet (dae d) f(X0,¥0) + R, 





@355 
where R,, is the remainder term given by 
1 5 5 n+l 
“n= re dl Gaur J(%9 + Oh, yo + Ok),0< O<1. (2.56 


Proof Let x = x9 + th Y = Yo + tk, where the parameter ¢ take in the i 
| ; : f takes values in the interval [0, !]. 
Define a function @(t) as (1) = f (x, y) =f (x9 + th, yo + tk), 


Using the chain rule, we get 
4, Ff dx Of dy of of 2 : 
a FS oe a at kay = (42 +k 2) 


“(t)= oO of * n+ . a 
o”(t) Gaus Pca OF = (12402) 7 


dy 
eck ylor’s theorem for a function of one variable (see Eq. (2.53)) with = 1 afd a = 0, we 


; 0(1) = (0) + p’(0) + e @°(O) +... + A o”) (0) + Le es gl) (9) (2.57) 


Kae (n+ 1)! 
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where ~(O) = f (x9, Yo) 
O(1) =f (x9 + h, yo + k) 


= (toed) f(%9,¥0),@= 1, 2,. 
Ox dy 


Substituting the expressions for (1), (0), ¢’(0),.. ., 9(0) and 9*"(@) in Eq. (2.57), we obtain 
the Taylor's theorem for functions of two variables as given in Eqs. (2.55) and (2.56). 


Substituting x = x) + h, y = yo + kK in Eq. (2.55), we can also write the Taylor’s theorem as 


| n+] 
gi"*D(g) = [1 + ‘2 | f (xo + 9h, yo + Ok),O< O< 1. 


f(x,y) = f(xo, yo) + [(x-a 2 0-90) 2 [f0.90) 


SL rat apt fl ) 
+ 37 | (4 — x0) = + y -Yo. oy XO» YO 





0d a |" 
at a= Hlo-me+o-wZ ff (0, Yo) + Ry, (2.58) 
where i ee caer n) (2.59) 
co 7 (n + I)! 0” Ox Se AO | oe 
and €= (1 — @)xo + Ox, nN=(1 — 8) yo + Oy, 0< O< 1. 
For n = 1, we get the linear polynomial approximation to f (x, y) as 


f (x, y) =f (Xo Yo) + %-— 0) fe +  — yo) fy (2.60) 
where the partial derivatives are evaluated at (Xp, yo). This equation is same as the equation (2.28) 


which was obtained using differentials. 
For n = 2, we get the second degree (quadratic) polynomial approximation to f (x, y) as 


f (x, y) =f or Yo) + (* — x0) fe + Y — Yo) fy 
+ [Ce 0)? fart 22 - x0 Y- Yo )fey + (9 — ¥0)? fy] (2.61) 


where the partial derivatives are evaluated at (xo, yo). 






aa ?* = f (0, 0) + lcs 9 sie O)+ > ie ty xy f (0, 0) 






eit, lalla 
Masine ale nic rtd) f(0, 0) + R, (2.62) 


2.40 Engineering Mathematics 


n+l 
Pitz HO sys? OxOy)- 0 BX 1, 
where R, = ERG c > +y 2) f(@x, Oy), 
(b) When lim R, = 0, we obtain the Taylor’s series expansion of the function f (x, y) about the 
n—>00 
point (x9, yo). 


ylor’s theorem can be easily extended to functions of m variables f (x), x2, . . ., x,,). 





fror estimate 


Since the point (€, 7) or the value of @ in the error term given in Eq. (2.59) is not known, we canno 
evaluate the error term exactly. However, it is possible to find a bound of the error term in a giver 
rectangular region R: | x — xy | < 6,, | y — yo| < 63. We assume that all the partial derivatives of the 
required order are continuous throughout this region. 





For n = | (linear approximation), the error term is given by 


R, = * [(x — x0) * fox + 2(x — x9) (y — yo) int OC — yo) fyy] (2.63) 


where the partial dirivatives are evaluated at the point (¢, 7) = [xp + A(x — x9), yo + OL 


= yo)I, 
0 < 6< 1. Hence, we get 


PRLS 5 C140? Lf + 21 *-2011¥-yol lfyl +1 y—yo |? Lf 1 


If we assume that 
B= max [| fx |, | fy |, | Ay |] for all (x, y) in R, then we obtain 
B | 
[Ri |< > []x-x0P +2|x-x9||y-y0 | +] y—yo PI 


B, _ 
= 7 (lx-x0l+ly-yl Ps 3 16+ 57 


This value of | R, | is called the maximum absolute error in the linear approximation of f (x, y) 
about the point (xo, yo). | 


(2.64) 


For n = 2 (quadratic approximation), the error term is given by 


Ra = =; (Ce —%5)* fone + 3(x — x0) (9 — yp) Frxy + 30 — 45) ( — yo)" fay + (9 — Yo)? fryy] (2-65) 


where the partial derivatives are evaluated at the point 


(S, 1) = [xo + A(x — Xo), Yo + O(y —yp)], 0 < Oe]. 
From Eq. (2.65), we get 


rae. 2 
|Rols ¢ Lleol" fer | +3 |x x01? | y - yo) | fay +3 |x — a0 11» yo [? Lf 
+] y—yo I? Ufees V1 


- Be 3 12 | 
Pa ml +3) 2>x| IY =¥o| +3 |x-xy1|y=yo |? +1 yy [7] 
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= ¢ (tml +ly-wI P< 2 6, +5, (2.66) 


where B = max [ Weve , | Beccy , Foy . 


Remark 8 





fyyy | ] for all points (, y) in R. 


In a similar manner, we can obtain error estimates for approximations of functions of three or more 
variables. For example, if f (x, y, z) is to be approximated by a first degree polynomial (linear 
approximation) about the point (Xo, Yo, Zo), then we have 


f (, y, Z) = P(x, y, z) =f (X%, Yo: 29) + [x - x) f+ O-yo A + (2 - WF] 


where the partial derivatives are evaluated at (Xo, Yo. Zo): Lhe error associated with this approximation 
is given by 


R, = > [= x9)" fa + (y — 99) fry + (Z — 20) fez + 2(% — X0) (Y — Yo) fay 
+ 2(x — X9) (Z — 2) fee + 2(y — Yo) (z — Z0) Jaz, I 


If we consider the region R: | x — x9 | < 6), | y- yo | < do, |Z— Z| < 63 


ly | | fel Ac 1) 


for all points (x, y, z) in this region, we can write 


and assume that B= max [| fx |, | Ay |, | fz 





Ri |S 5 (1x-x0l+ly-yl+|z-zl P< 2 6, + 52+ 65) 


Example 2.30 Find the linear and the quadratic Taylor series polynomial approximations to the 
function f(x, y) =2x° + 3y° — 4x? y about the point (1, 2). Obtain the maximum absolute error in the 
region | x —1|< 0.01 and|y—2|<0.1. 

Solution We have 


Tee y) = 2x7 + 3y? — 4x*y : FC, 2) =18 


fi, (&, y) = 6x" — 8xy | #2) =—10 
fy (x, y) = Oy? — 4x° ote fC 32 
fx (, y) = 12x — By ee 2 —— 
fry (X, y) = — 8x BiG yess 
Ty %,.¥) = 18y | biyy (h2)'= 36 


Ton, ¥) = 12, fay@.y)=-8, Sny™ y) =0,f,,@, y) = 18. 
The linear approximation is given by 
f(y) =f (1, 2) + (@- DAC, 2) + © = 2) 6.1, 2)) 
| = 18 + (x— 1) C10) + (y — 2) (32) = 18 - 10~@ ~ 1) + 32(y — 2). 
a Ma ximum absolute error in the linear approximation is given by 


ee [Riis 3 Ule-11+ly-217 s 2 (01) + 0.172 = 0.00605 B 


“= i 
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, | fy | ] in the given region | x - 1 |< 0.01,|y-—2|< 9.1. 





where B = max [ | fx |, | fy 
Now, max | f,, | = max | 12 x - 8y | = max | 12(7 - 1) —8(y -2) -4 | 
< max [ 12|x-1|+8|y-2|+4] =4.92 
max | f,, | = max | — 8x | = max | 8(x — 1) + 8 | S max [8 | x -— 1 | + 8] = 8.08 
max | f,, | = max | 18y | = max [ 18(y - 2) + 36] Ss max [18 | y—2| + 36 ] = 37.8. 
Hence, | B | = 37.8 and | R, | < 0.00605(37.8) = 0.23. 
The quadratic approximation is given by 


fay) =fC, 2)+164-DAC, 2+ 0-DAC, 2) 


+ 4 [@ - 1)? £0, 2) + 2-1 (W—2) fy (1. 2) + © — 2)’ fy CL, 20] 


= 18 — 10(¢— 1) + 32G'—2) + = [-4(x— 1)*- 16(@ - 1) (v - 2) + 369 - 2)"] 
= 18 - 10@-1)4+32(y -—2)-2[@- 1)* + 4(¢ - 1) (y — 2) = Oy — 2y'). 
Using Eq. (2.66), the maximum absolute error in the quadratic approximation is given by 
|RoI< SU |x-1]+]y-21 P< 2 uy = 2 001331) 
where B= max [ | Fro |; ies |, kbs , kecse | ] = max [ 12, 8, 0, 18 ] = 18. 
Hence, we obtain 
| 2 |< B (0.001331) = 0.004. 


Example 2.31 Expand f (x, y) = 21 + x—-20y + 4x7 + xy + 6y” in Taylor series of maximum order 
about the point (—1, 2). 


Solution Since all the third order partial derivatives of f (x, y) are zero, the maximum order of the 
Taylor series expansion of f (x, y) about the point (—1, 2) is two. We obtain 


f(x,y) =f(-1, 2) + (. + 1) L + (y — 2) 2 hc, 2)+ 4 ( +1) 2 + (y — 2) 3] fC, 2). 
We have 

F(-l, 2)=6, f,@, y)=14 8x4+y, f.(-1, 2) =-5. 

fy y)=-204+x+4 12y, fl, 2) =3, 

Fur % ¥) = 8, fy (& y) = 1, fy (x, y) = 12. 
Therefore, 


F(% y) = 6 —S(x + 1) + 3-2) + 4 + 1)? + x + 1) (y — 2) + 6(y - 2). 
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This is an rearrangement of the terms in the given function. 


Example 2.32 The function f (x, y) = x* — xy + y’ is approximated by a first degree Taylor's 
polynomial about the point (2, 3). Find a square | x - 2|< 6,| y- 3 | < 6 with centre at (2, 3) 
such that the error of approximation is less than or equal to 0.1 in magnitude for all points within this 
square. 


Solution We have f, = 2x — y, fy =2y-2, f,=2, fy =- 1, ie a). 
The maximum absolute error in the first degree approximation is given by 


[Ri |< 2 (|x-2|+ly-31P 
where B = max [ eee | Wiese |, | Fas | ] = max [2 Ite 2| =H 
We also have | x - 2| < 6,| y—3| <6. Therefore, we want to determine 6 such that 


|R, |< 5 [5+ 6]* <0.1, or 462 < 0.1, or 5< 0.025 = 0.1581. 


Example 2.33 If f (x, y) = tan”! (xy), find an approximate value of f (1.1, 0.8) using the Taylor’s 
series (1) linear approximation and (11) quadratic approximation. 


Saintion Let (xp, yo) = (1.0, 1.0), k= 0.1, K=— 0.2, Then f (1.1, 0.8) =f (1 + 0.1, 1 = 0-2). 


(1) Using the Taylor series linear approximation, we have 


se he eS 
FfCUA, 0.8)= fC, D+ [ Ap +k ra, 3) 


From f (x, y) = tan '(xy), we get 
fd, 1) =tan“"(1) = 2/4 = 0.7854 


fx (% Y) = <a Ix, N= 4, A yi= aoe Ad. 1) = t 
Therefore, 
f (1-1, 0.8) = 0.7854 + ‘3 1 +46 02)| Biren, 
(ii) Using the Taylor series quadratic approximation, we have 
‘We have 


2x7 y 


2xy° 
Pay) = ———_—_—— 5 fx (l,l) = — =; f,, (x, y) = — 


(1 


aes) Cry) 2 1 — xy 
(1 ate ea) (1 roe ye 12 1) = 0. 


fouls I) = -5 


-_ -Therefore, using the result of (i), we obtain 
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tf 


f (1.1, 0.8) = 0.7354 + {0.01 (-3 + 2(0.1) (— 0.2) (0) + (0.0 4)  - ) 


4 
2 
= 0.7354 — 0.0125 = 0.7229. 


The exact value of f(1.1, 0.8) to four decimal places is 0.7217. Thus, the accuracy Increases 
as the order of approximation increases. 


Exercises 2,3 


Find all the partial derivatives of the specified order for the following functions at the given point: 


_— 
= 


11. 


Ez. 
13. 
14 


Is. 
16. 


17. 


18. 


eC eon Aum Fw NY 


f (x, y) = [v- y]/ [x + y], second order at (1, 1). 

f(x y) =x In y, third order at (2, 3). 

Ff (x, y) = In [U/x) - (1/y)], second order at (1, 2). 

f (x, y) = e* In y + (cos y) In x, third order at (1, 77/2). 
f(y) = e8™@, second order at (77/2,1). 


f (x, y, z) = [x + y)/[x + z], second order at (1, -1, 1). 


ye 2 
- JG, y,z) = e* *” ** , second order at (-1, 1, —1). 


- f @, y, Z) = sin xy + sin xz + sin yz, second order at (1, 2/2, 7/2). 


Foe 


~f(xy,2= i + — + =, second order at (1, 2, 3). 





a7 Ff 
= cya ; ' t ie | 
EQ yy 2) = xy? a) at any point (x, y, z) # (0, 0, 0). 
x? y(x-y) ; 
For the function 7(2y)= x7 4+y? ’ (x, y) # (0, 0) 


Oise) =1(0):0) 
show that f,, # f,, at (0, 0). 


Show that Sey = fx for all (x, y) # (0, 0), when Fi, y) = x’. 


Show that fy = f,. for all (x, y) # (0, 0), when f (x, y) = log [x + Vy? 4x2], 
Show that f,,. = fyzx for all (x, y, z), when f (x, y, z) = e®” sin Z, 


Show that fryyz = fyyxe for all (x, y, z), when f (x, y, z) = z2ex+)?- 

If z = e* sin y + e” cos x, where x and y are implicit functions of 7 def; 
eo e+ eth +t—-1=Oand yt +yst+1+y=0, then find dz/dt at t= 0. 
If x and y are defined as functions of u, v by the implicit equations x* — y* + 2y?+ 3y?— 1 = 0 
and 2x? — y? — 4? + 4y2- 2 = 0, then find Ax/du, Ay/du, A2x/A u2 and a “vidu?. 

If u and v are defined as functions of x and y by the implicit equations 4.x? + 3y* —z* yu? +0 = 


Bx° = 2y* $ 22 + ue? + 2p? = 14, then find (Au/dx),. and (dv /Oy),, atx = 1. y=-l,z=2. 
Assume that u > 0, v > 0. 


ned by the equations 


S 


If x y1—y? +yV1—x? =c, c any constant, |x|<1,| y| <1, then find dyldx and d2y /dx’ 
Find dy/dx and d*y/dx* at the point (x, y) = (1, 1), for e” 


—e* + xXp= |. 
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21. Ifz=u', u=(x/y), v = xy, then find 0°z/0 x’. 


22. Ifu=In(I/r), r= 4(x-a)? +(y—b)* , then show that u,, + Uyy = 0. 


23. If F=f (u,v), 4=y+ax,v=- y — ax, a any constant, then show that F,, = a Pyys 
24. If f(x, y) =x log (y/x) , (x, y) # (0, 0), then show that xf, + 2xy fry + ¥ Sy = 0. 
25. If f (x,y) = yl’ + y’), (x, y) 4 (0, 0), then show that f,. + Ay = 9. 
26. Find @ and B such that u(x, y) = e+” satisfies the equation U,, — 7Uyy + 12uyy = 0. 
27. Ifz=f(u, v), u = x/(x* + y’), pe wie 4 y?), (x, y) # (0, 0), then show that 

uu + Zp =X" + Y°)? (2 + By): 


28. Ifx=rcos 0, y=r sin @, then show that 





020 cos 2 0 2 7 
dx dy r? au) dx dy De 


Using Euler's theorem, establish the following results. 


: x? +y? @) 
29. fe =sin— | — | then ee yee Stan 
X+y dy 


ax 
ae 2 
ey du Ou 
30. If u = log | ————— |, then x—+y—=0O. 
| : en oe Yay 
: as% Dos Ou Ou 
31. If w= y? —¥- sin"'{ *) then ae al 
eo aes 0 0 2 2 _ a2 
ys u u 1 20° O*u 2 0O-u 
32. If «= —— then x —+y— =u and x* ——+2xy —— + — -— () 
: yet eer Ox > Oy dx? ” Ox dy f dy? 
3 3 9 
33. If tan u = eae then pot ee Ee 2u and 
x-y Ox dy 








2 2 
x _ + 2xy — +y? at = (1 —4sin*u) sin 2u. 
x 


34. Obtain the Taylor’s series expansion of the maximum order for the function 
Gy) = x” + 3y* — 9x — 9y + 26 about the point (2, 2). 


35. Obtain the Taylor’s linear approximation to the function f(x, y) = 2x? - xy + y? + ee 4y +1 
about the point (1, 1). Find the maximum error in the region | x + 1] <0.1,| y-1 |< 0.1. 


36. Obtain the first degree Taylor’s series approximation to the function f(x, y) =e” In (x + y) about the point 
(1, 0). Estimate the maximum absolute error over the rectangle | x — 1 |< 0.1, | y |< 0.1. 


37. Obtain the second order Taylor’s series approximation to the function f (x, y) = xy? + y cos (x — y) about 
the point (1, 1). Find the maximum absolute error in the region | x — | |< 0.05, | y-1]<0.1. 

38. Expand f (x, y) = xf x+y in Taylor’s series upto second order terms about the point (1, 3). Estimate the 
maximum absolute error in the region | x - 1 |< 0.2, | y-3]<0.1. 

39. Obtain the Taylor’s series expansion, upto third degree terms, of the function f (x, y) = e?** about the 
point (0, 0). Obtain the maximum error in the region | x | < 0.1, | y | < 0.2. 


40. Expand f (x, y) = sin (x + 2y) in Taylor’s series upto third order terms about the point (0, 0). Find the 
| maximum error over the rectangle |x|<0.1,]y |<0.1. ) 
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‘der terms about the point (71/4, 7/4), 
‘1a in Tavior’s series upto second order terms a ip 
| iy —<sinx: in Taylor's series up 
41. Expand f (x, y) = sin x sin y 


| — 1/4) < 0,1. 
the maximum error in the region | x - 2/4 | < 0.1, |y— 2/4 | 





| : “rst order terms about the point (2. 9 
2 in Taylor series upto first order terms abou | 





42. Expand f (x, y,z)= yx +y +2 , ; ) Serre 
Obtain the maximum error in the region | x - 2 | < 0.1, |y-2|<0.1,}z | 


43. Expand f (x, y, z) = «xy + yz +xz in Taylor's series upto first order terms about the point (1, 3, 3/7 
ye J Apanc ‘4 J - “ : , ee 4/9 , 0) : | 
Obtain the maximum error in the region |x-1[<0.1,|y-3|<9.1,]2 | 


Ls ‘ ; rh a yr » TM i! | 
44. Expand f (x, y, z) = e* sin (x + y) in Taylor's series upto second sich i about the point (0, 0. ¢ 
Obtain the maximum error in the region | x | < 0.1, | y |< 0.1, | z | 


45. Expand f (x, y, z) = e* sin (yz) in Taylor’s series upto second order terms Ske point (0, |, 1/2 
Obtain the maximum error in the region |x| <0.1,|y-1|<01,] 2-7/2] <9}. 


2.5 Maximum and Minimum Values of a Function 


Let a function f (x, y) be defined and continuous in some closed and bounded region R. kt (a, oy 
an interior point of R and (a + h, b + k) be a point in its neighborhood and lies inside K. We defin 
the following. 


(i) The point (a, b) is called a point of relative (or local) minimum, if 
f(at+h, b+ k) 2 f(a, b) (2.67% 


for all h, k. Then, f (a, 6) is called the relative (or local) minimum value. 


(ii) The point (a, 5) is called a point of relative (or local) maximum, if 


f(a+h,b+k) < f(a, b) (2.676 
for all h, k. Then f (a, b) is called the relative (or local) maximum value. 


A function f (x, y) may also attain its minimum or maximum values on the boundary of the region 
The smallest and the largest values attained by a function over the entire region including th 


boundary are called the absolute (or global) minimum and absolute 


(or global) maximum value 
respectively. 


The points at which minimum / maximum values of the function occur are also called points 0, 
extrema or the stationary points and the minimum and the maximum values taken together are callec 
the extreme values of the function. 


We now present the necessary conditions for the existence of an extremum of a functon. 


Theorem 2.6 (Necessary conditions for a function 


F (x, y) be continuous and possess first order partial derivatives at a point P(a, b). Then, the necessary 
conditions for the existence of an extreme value of f at t oe 


he point P are f,(a, b) = 0 and f,(a, b) = 9 

Proof Let (a+h,b+k) bea point in the neighborhood of int P(a. } ill be a pol 
1oth nt in t hood of the e a point 

of maximum: if ent of the point P(a, b). Then, P will be a po 


to have an extremum) Let the function 


Af=f(at+h,b+k)-f(a,b)<0 forall h, k (2.68) 
and a point of minimum, if 
Af=f(a+h, b + k)—f (a, b)>0 for all h, k. 


Using the Taylor’s series expansion about the point (a, b), we obtain 


(2.69) 
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flat+h, 0+ k)= f(a, b) 4 (Af. + Kfy oa py + 5 (hf. + 2hk fey + kf yy) cap) dear. eet) 
Neglecting the second and higher order lerms, we pet 

Afe hf a, b) + kf,(a, b). (2.71) 
The sign of Afin Eq. (2,71) depends on the sign of hf,(a, b) +k f,(a, b) which is a function of h and 
k, Letting A — O, we find that Af changes sign with k. Therefore, the function cannot have an 
extremum unless /, = 0, Similarly, letting k —» 0, we find that the function f cannot have an extremum 
unless f, = O | 
Therefore, the necessary conditions for the existence of an extremum at the point (a, b) is that 


I(a,b)=0 and f, (a, b) = 0. (2.72) 


A point P(a, b), where f, (a, b) = 0 and f(a, b) = 0 is called a critical point or a stationary point. A 
point P 1s also called a critical point when one or both of the first order partial derivatives do not exist 
at this point, 


Remark 9 
To find the minimum/maximum values of a function f, we first find all the critical points. We then 


examine each critical point to decide whether at this point the function has a minimum value or a 
maximum value using the sufficient conditions. 


Theorem 2.7 (Sufficient conditions for a function to have a minimum/maximum) Let a function 
/ (x, y) be continuous and possess first and second order partial derivatives at a point P(a, b). If P(a, b) 
Is a critical point, then the point P is a point of 


relative minimum if rt—s* >Oandr>0 (2:73a) 
relative maximum if rt—s? > 0 and r<0 (2.73b) 
where r = uni Q, bh), S = fry(a, b) and ¢ = fyy(a, b). 


No conclusion about an extremum can be drawn if rt — 5? = 0 and further investi gation is needed. 
If rt — s* < 0, then the function f has no minimum or maximum at this point. In this case, the point 
P is called a saddle point. 


Proof Let (a +h, b +k) be a point in the neighborhood of the point P(a, b). Since P is a critical point, 
we have f, (a, b) = 0, and f, (a, b) = 0. Neglecting the third and higher order terms in the Taylor’s series 
expansion of f(a + h, b + k) about the point (a, b), we get 


) Lica | 
Af=f(a+ h,b+ k)-fla, b)= > [h*fx(a, b) + 2hk fry (a, b) + k*f,y (a, b)] 
= 4 (Wr + 2hks + 1 = 5 (hr? + 2hkrs + rt) 
= - (hr + ks)? + (rt = 8*)). (2.74) 


(hr + ks)’ > 0, the sufficient condition for the expression (hr + ks)? + (rt — s’) to be positive 


= 







is that rt — 5? > 0. 
2 Af>0 if r>0 and Af<O if r<Q. 


Therefore, a sufficient condition for the critical point P (a, b) to be a 
5 ’ q 


y 
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point of relative minimum is rf— s*>0O and r>0 
point of relative maximum Is rt — s*>0O and r<0O. 
If rt — s* < 0, then the sign of Af in Eq. (2.74) depends on A and k. Hence, no maximum/minimy, 
of f can occur at P(a, 6) in this case. 
If rt —s* =O orr=t=s = 0, no conclusion can be drawn and the terms involving higher orde 
partial derivatives must be considered. 
Remark 10 
(a) We can also write Eq. (2.74) as 


Af = = (ker? + Qhkst + h?rt] = * (kt + hs)? + (rt- s*)h?]. 
Hence, a sufficient condition for a critical point P(a, b) to be a 

point of relative minimum is rt — s* > 0 and r > 0 

point of relative maximum is rt — s* > 0 and t < 0. 


From these conditions and Eqs. (2.73a, 2.73b), we find that when an extremum exists, ther 
rt—s* > 0, and both r and t have the same sign either positive or negative. 


(b) Alternate statement of Theorem 2.7 
A real symmetric matrix A = (a,) is called a positive definite matrix, if 


x’ Ax>0 for all real vectors x # 0 
fl fn 
or 2 Py ay x; x; > 0 for all x;, x; (see section 3.5.3). 


A sufficient condition for the matrix A to be positive definite is that the minors of all its leading 
submatrices are positive. Now we state the result. Let 


heiress 
AY t 
where r= f,,(a, b), 5=f,y(a, b) =f,,(a, b) and t=f, (a, b). Then, the function f (x, y) has a relative 


minimum at a critical point P(a, b), if the matrix A is positive definite. Since all the leading 
minors of A are positive, we obtain the conditions r > 0 and rt— 52> 0. 


The function f(x, y) has a relative maximum at P(a, b), if the matrix B =— A = oe | is 
=e +t 


positive definite. Since all the leading minors of B are 


2 3 positive, we obtain the conditions — 7 > 9 
and rt — 5° > 0, that is r<O and rt—s?>0. | 


_ This alternative statement of the Theorem 2.7 is useful when we consider the extreme values of 
the functions of three or more variables. For example, for the function f(x, y, z) of three variables. 


we have 
tiny Ixy Tixz 
A = Fyx Syy Sys | 
Tet Fry Sez 


Functions of Several Real Variables 2.49 


where fx =f tu = Sra fy = fiz. The matrix A or the matrix B = — A can be tested whether it 1s 


positive definite, to find the points of minimum/maximum. Therefore, a critical point (a point at 
which f, = 0 =f = f;) 


(i) is a point of relative minimum if A is positive definite and f,,, fyy, fr, are all positive. 
(ii) is a point of relative maximum if B =— A is positive definite (that is, the leading minors of 
A are alternately negative and positive) and fi... fy» fe, are alll negative. 


Example 2.34 Find the relative maximum and minimum values of the function 
f (x, y) = 2(x? - y*) — x* + y’. 

Solution We have 

f= 4x -— 4° = 0, or x = 0, +1 

fy =— 4y + 4y’ = 0, or y =0, 41. 
Hence, (0, 0), ( 0, +1), (+1, 0), (1, +1) are the critical points. We find that 

r =f =4-12x*, s=fy=0, t=fy=-4+ 12y? 

and rt —s* =—16(1—3x°) (1 — 3y°). 


At the points (0, 1) and (0, —1), we have rt — s* = 32 > 0 and r=4 > 0. Therefore, the points (0, 1) 
and (0, —1) are points of relative minimum and the minimum value at each point is —1. 


At the points (—1, 0) and (1, 0), we have rt — s* = 32>0Oandr=—8<0. The points (—1, 0) , (1, 0) 
are points of relative maximum and the maximum value at each point is 1. 


At (0, 0), we have rt — s’> = — 16 <0. At (+1, +1), we have rt — 5? =— 64 < 0. Hence, the points 
(0, 0) (+1, +1) are neither the points of maximum nor minimum. 


Example 2.35 Find the absolute maximum and minimum values of 
f (x, y) = 4x* + Sy? — 8x — l2y + 4 
over the rectangle in the first quadrant bounded by the lines x = 2, y = 3 and the coordinate axes. 


Solution The function f can attain maximum/minimum values at the critical points or on the 
boundary of the rectangle OABC (Fig. 2.4). 





a) ra 


. Fig. 2.4, Region in Example 2.35, 
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We have f, = 8x - 8 = 0, f, = 18y — 12 = 0. The critical point is (x, y) = (1, 2/3). Noy 
r=f,=8, S=fy=0, t=fy = 18, rt—s° = 144. 

Since rt — s? > 0 and r> 0, the point (1, 2/3) is a point of relative minimum. The minimum value ;, 

Fh, 223) ==4. 


On the boundary line OA, we have y = 0 and f (x, y) =f (x, 0) = g(x) = 4x? — 8x + 4, which js , 
function of one variable. Setting dg/dx = 0, we get 8x —- 8 =0 or x= 1. Now d*g/dx*=8>0. Therefore 
at x = 1, the function has a minimum. The minimum value is g(1) = 0. Also, at the corne,, 
(0, 0), (2, 0), we have f (0, 0) = 2(0) =4, f (2, 0) =9(2) =4. 


Similarly, along the other boundary lines, we have the following results: 
x=2: h(y) = 9y*- 12y +4: dhidy = 18y - 12 = 0 gives y = 2/3: d*hldy’ = 18 > 0. Therefore. 


y = 2/3 is a point of minimum. The minimum value is f (2, 2/3) = 0. At the corner (2, 3), we 
have f (2, 3) = 49. 


y=3: g(x) =4x* — 8x + 49; dg/dx = 8x — 8 = 0 gives x = 1; d*gldx* = 8 > 0. Therefore, G=1 isa 
point of minimum. The minimum value is f (1, 3) = 45. At the corner point (0, 3), we have 
f (0, 3) = 49. 


x=0: h(y) = 9y* - 12y + 4, which is the same case as for x = 2. 


Therefore, the absolute minimum value is — 4 which occurs at (1, 2/3) and the absolute maximum 
value is 49 which occurs at the points (2, 3) and (0, 3). 


Example 2.36 Find the absolute maximum and minimum values of the function 

f (x, y) = 3x7 + y* — x over the region 2x7 + y*< 1. 
Solution We have f, = 6x — 1 = 0 and f, = 2y = 0. Therefore, the critical point is (x, y) = (1/6, 0). 
Now, r=f,=0, s=f,=0, t=f, =2, rt—s*=12>0. 
Therefore, (1/6, 0) is a point of minimum. The minimum value at this point is f(1/6, 0) = — 1/12. 
On the boundary, we have y* = 1 — 2x”, _1/,/2<x< 1/-/2. . Substituting in f (x, y), we obtain 

f (% y) = 3x + (1 - 2x7) -x = 1-x 422 = p(x) 
which is a function of one variable. Setting de/dx = 0, we get 

£8 -2-1=0,08 Kas. Also #8 230 


For x = 1/2, we get y’ = 1 - 2x? = 1/2 or y= + L/J2. Hence. the points (1/2, + 1/V2) 
are points of minimum. The minimum value is FOR, £ iV2)}.= 3/4. At th ces, we have 
: 5 = 3/4. € vertices, we ha 
f (2,0) = G— V2)/2, f(—WV2,0) = 3 + V2)/2, FO, + 1) = 1. Therefore, the given function 
has absolute minimum value — 1/12 at (1/6, 0) and absolute maximum value (3 + /2)/2 at (- 1/ 2, 0). 
Example 2.37 Find the relative maximum/minimum values of the function 

f (, y, 2) = x* + y4 + 24 yy, 

Solution We have 
fx= 4x" — 4yz =0, f, = 4y? — daz = 0, f= 42 — dry = 0. 


oe ae ae Sys | 
Therefore, x = VY =x P= xy or xyz = x*y*z? or xy*z" (xyz —- 1) = 0. 
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Therefore, all points which satisfy 
equations are (0, 0, 0), (1, 1, 1), (41. 
two coordinates. Now, 


xyz = O or xyz = | are critical points. The solutions of these 
£1, 1), (1, £1, £1), 1, 1, +1) with the same sign taken for the 


fax = 12x", Jyy =a ye, fz = 122°, Ty =—42, fz =— 4), Fyz = re 
At (0, 0, 0), all the second order partial derivatives are zero. Therefore, no conclusion can be drawn. 
12° 42 = 45) 
We have A= |'—47 "129" “=4y) 
—4y <=4y 1277 


Depending on whether A or B=— A is positive definite, we can decide the points of minimum or 
maximum. The leading minors are 








IDs 44 ; ; 
Mj = 1237,M,—| N= 1GKer yy = 22) 
=47 12'y? 
and M; =| A |= 192x? (9y*z* — x?) — 19224 — 64 xyz— 64x yz— 192 y* 


= 192 [9x*y2z? — (x4 + y* + z4)] — 128xyz. 


At all points (1, 1, 1), (£1, +1, 1), (£1, 1,+1), (1, +1, 1) with the same sign taken for two coordinates, 
we find that M, > 0, M, > 0 and M; > 0. Hence, A is a positive definite matrix and the given function 
has relative minimum at all these points, since ln Of > 0, and £, 


> Q. The relative minimum 
value at all these points is same and is given by f(1, 1, 1) =—1. 


Conditional maximum/minimum 


In many practical problems, we need to find the maximum/minimum value of a function 
Ff (%, x, . . . , X,) when the variables are not independent but are connected by one or more constraints 
of the form 


(41, %2.- +X) = 0, 1=1,2,...,k 


Where generally n > k. We present the Lagrange method of multipliers to find the 


solution of such 
problems. 


2.5.1 Lagrange Method of Multipliers 
We want to find the extremum of the function f (x;, x2, . . ., x,) under the conditions 


Qj (%1, 2, +++ Xn) =O, (= 1,2,...,k, 


(2.75) 
We construct an auxiliary function of the form 


k 
F(x}, X4,. - = #9 An» Ai, A>, oe o8y Ay) =f (1, AD, s hoy Xn) Us Pp» A; 0; (x, +X 3,2 * 8s Bene (2.76) 


where A,’s are undetermined parameters and are known as Lagrange multipliers. Then, to determine 
J _the stationary points of F, we have the necessary conditions 











i 
Li 
th 
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k Od. 
LN ae eee tr ee (2.7 
Ox; f=I Ox; 
From Eqs. (2.75) and (2.77), we obtain (n + k) equations in (n : k) unknowns My BQ, .. ., y 
Ai, Abs + « & Ax Solving these equations, we obtain the required stationary points ijn Xo, . .. ee), 


which the function f has an extremum. Further investigation is needed to determine the exact natu; 
of these points. 


, ’ ur 2 ) 2 | “43 wee 
Example 2.38 Find the minimum value of x” + y” + z” subject to the condition xyz = a? 


Solution Consider the auxiliary function 
FG; y,z, 2) = x? + y" ee A (xyz — a>) 
We obtain the necessary conditions for extremum as 
lay OF _» Py oe 2 tay = 
—— = XS = — = +Axz=0, —=2z+ XY ‘ 
5 2x + Ayz = 0, a y a 
From these equations, we obtain 
Ayz = — 2x or Axyz = — 2x" 
A xz =— 2y or Axyz = — 2y ” 
A xy =— 2z or Axyz = — 22”. 


Therefore, x* = y? = z?. Using the condition xyz = a°, we obtain the solutions as (a, a, a). 
(a, — a, — a), (— a, a, — a) and (-a, — a, a). At each of these points, the value of the given function is 


x? + y* + 27 = 3q?, 

Now, the arithmetic mean of x2, y*, 2 is AM = ons y? + z7)/3 
the geometric mean of x”, y?, z* is GM = (x*y7z*)15 — gq? 

Since, AM > GM, we obtain x? + y? + 22 > 3,2. 


Hence, all the aboye points are the points 


of constrained minimum and the minimum value of 
x+y + 2 is 3a. 


Example 2.39 Find the extreme value 


S of f (x, V5 2) = Qe 4 3y + z Such that x° + y? = 3 
and x+z= 1. 


Solution Consider the auxiliary function 


F(x, y, z, A, Ay) = 2x + Sy+Z+A, (x7 + y?— 5) + Ay (x+7z- 1). 
For the extremum, we have the necessary conditions 


OF _ OF OF 
Oy 2 + 2Aix + Az =0; ay omy =, oe ot Ae = 0. 


From these equations, we get 


ee 3+2A,y=0 and 1+2A,x=0 
x=— I/(2A,) and y =~ 3/(2A,). 
Substituting in the constraint x2 + y? = 5, we get 


or 
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i 9 | ] ! 


For A, = 1/2, we get x = - J2/2, y=— 32/2. c=1-x= (2+ V2)2 





Eset) = ~ 912 ~ ~ ms Se Shoe ee j = 54/2. 


For A, =-— 1/2, we get “= 2/2. y = 32/2, z=l=ex=(C- 2 )/2 





and F (ey Z) a faee abe canes 2+ LONE ay Saf. 


Example 2.40 Find the shortest distance between the line y = 10 — 2x and the ellipse 


(x/4) + (y7/9) = 1. 
Solution Let (x, y) be a point on the ellipse and (u, v) be a point on the line. Then, the shortest 
distance between the line and the ellipse is the square root of the minimum value of 

f (%, y, u,v) = (x—u)? + (y-v) 
subject to the constraints 


x2 y? 


(x, y)= +> -1=0 and @,(u,v)=2u+vu—10=0. 


We define the auxiliary function as 


2 2 
F(x, y, u, Vv, Ay, Ap) = (x— uw)? + (y—v)? + a(t + > - 1 + Az(2u+v — 10). 
For extremum, we have the necessary conditions 


of 2(x - u) + +A, =0, or A, x = 4(u — x) 


x = Ay y-v)+ 2d, =0, or A,y = 9(u — y) 


OF = -2(x-u) + 2A, = (js Or A, =X -—UHu 


oe —2(y —v) + A, =0, or Az =2(y - v). 







 &zl eee g A, and A, from the above equations, we get 
J 
A(u —x)y =9(U -—y)x and x-u= 2(y — v). 
the Dive equations, we obtain 8y = 9x. Substituting in the equation of the ellipse, we get 


Ova), 64 
» t e+ ee 21, = Oe 
i" 64 or x 5 


re,x=+ 8/5 and y = + 9/5. Corresponding to x = 8/5, y = 9/5, we get 





$-u=2{2-v), OT 20 = =. 2 or u=2U—- 


Nh 


5 


Substituting in the equation of the line 2u + v — 10 = 0, we get u = 18/5 and v = 14/5. 


Hence, an extremum is obtained when (x, y) = (8/5, 9/5) and (u, v) = (18/5, 14/5). The dis 
between the two points is //5. 


Corresponding to x = — 8/5, y = — 9/5, we get u — 2u = 2. Substituting In the equ: 
2u + v — 10 = 0, we obtain uw = 22/5, v = 6/5. Hence, another extremum Is obtained y 
(x, y) = (-8/5, — 9/5) and (u, v) = (22/5, 6/5). The distance between these two points is 34/5, 


Hence, the shortest distance between the line and the ellipse is V5. 


Exercise 2.4 


Test the following functions for relative maximum and minimum. 


1. xy + (9/x) + (3/y). 2. a2 —x? -y? a>0. 


3. x? + Qbxy + y’. A, x + xy + y° + (1A) + (I/y). 

Sx + 2/(x*y) + ae 6. cos 2x + cos y+ cos (2x + y),O<x,y<7. 

7a Axe dy l2xy — 6y + z. 8. 18xz — 6xy — 9x* — 2y* — 5427. : 
9, x* + y+ 27 + Axyz, 10. 2Inw+y+z)—O?+y?+27),x+y+7z>0. 


Find the relative and absolute maximum and minimum values for the following functions in the given clc 
region R in problemes 11 to 20. 

Al. x? — y? — 2y, R: x2 + y? $1, 12. xy, Rix + y? < 1. 

13. x+y, R: 4x? + Dy? < 36, 14. 4x7 + y?-2¢ 41, R: ax ey? 1 

15. x° + y’-x-y + 1, R: rectangular region; 0< x <2. 0 Sy 2. 

16. 2x° + y° — 2x — 2y — 4, R: triangular region bounded by the lines x = 0, y = 0 and 2x + y = 1. 

17. x’ + y> — xy, R: triangular region bounded by the lines x= 1, y= 0 and y = 2x. 

18. 4x° + 2y? + 4xy — 10x — 2y — 3, R: rectangular region; OS x <3,-4<y<2, 

19. cos x + cos y + cos (x + y), R: rectangular region; 0< x < 7,0 < y= 7 

20. cos x cos y cos (x + y), R: rectangular region; O<x<7,0< YS. 


21. Show that the necessary condition for the existence 
is that x, y satisfy the equation Ix —fy % = 0. 


22. Find the smallest and the largest 


of an extreme value of f (x, y) such that @(x, y) = 


value of xy on the line segment x + 2y=2,x>0, y>0. 
23. Find the smallest and the largest value of x + 2y on the circle x7 + y? = 1, 


24. Find the smallest and the largest value of 2x — y on the curve x — sin y=0,0<y<2z. 


25. Find the extreme value of x? + y2 when x4 + yt =1. 


26. Find the points on the curve x2 + xy + y* = 16, which are nearest and farthest from the origin. 


27. Find the rectangle of constant perimeter whose diagonal is maximum. 
28. Find the triangle whose perimeter is constant and has largest area. 
29. Find a point on the plane Ax + By + cz = D which is nearest to origin. 


30. Find the extreme value of xyz, when x + y+tz=aa>0. 
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3], Find the extreme value of a?x2 + b*y? + c3z* such that x! + y'! + 2! =1, wherea>0,b>0,c>09. 
32. Find the extreme value of x? 


+ y? + z? on the surface x? + y? + z? = 1, where 0 < p < q, 
x¥> 0, y > 0, z> 0. 


33. Find the extreme value of x° + 8y3 + 6473. when xyz = 1. 
34, Find the dimensions of a rectangular parallelopiped of maximum volume with edges parallel to the 
coordinate axes that can be inscribed in the ellipsoid (x7/a’) + (y*/b*) + (ic y=, 


35. Divide a number into three parts such that the product of the first, square of the second and cube of the 
third is maximum. 


36. Find the dimensions of a rectangular parallelopiped of fixed total edge length with maximum surface area. 
37. Find the dimensions of a rectangular parallelopiped of greatest volume having constant surface area S. 


38. A rectangular box without top is to have a given volume. How should the box be made so as to use the 
least material. 


39. Find the dimensions of a right circular cone of fixed lateral area with minimum volume. 


40. A tent is to be made in the form of a right circular cylinder surmounted by a cone. Find the ratios of the 
height H of the cylinder and the height h of the conical part to the radius r of the base, if the volume V 
of the tent is maximum for a given surface area S of the tent. 


41. Find the maximum value of xyz under the constraints x? + z? = 1 and y —x = 0. 
= 
42. Find the extreme value of x” + 2xy + z* under the constraints 2x + y = 0 and x + a ee ame Ie 


43. Find the extreme value of x* + y? + z* + xy + xz + yz under the constraints x + y + z= ] and 
x + 2y + 3z = 3. 


44. Find the points on the ellipse obtained by the intersection of the plane x + z = 1 and the ellipsoid 
x* + y* + 2z* = 1 which are nearest and farthest from the origin. 


45. Find the smallest and the largest distance between the'points P and Q such that P lies on the plane 
x+y +z= 2a and Q lies on the sphere x* + y* + z* = a’, where a is any constant. 


2.6 Multiple Integrals 


b 
In the previous chapter, we studied methods for evaluating the definite integral f(x)dx, where 


| : i ) : a 
the integrand f(x) is piecewise continuous on the interval [a, b]. In this section, we shall discuss 
methods for evaluating the double and triple integrals, that is integrals of the forms 


{| f(x, y)dx dy and if] F(x, y, z)dx dy dz. 
J 5 “ 


We assume that the integrand f is continuous at all points inside and on the boundary of the region 
R or T. These integrals are called multiple integrals. The multiple integral over IR” is written as 


{J } | F(X, %2, Bair ,X,)dx,dx5 a Mae 
he 


2.6.1 Double Integrals 


saley, t f (x, y) be a continuous function in a simply connected, closed and bounded region R in a two 
jensional space IR? , bounded by a simple closed curve C (Fig. 2.5). 
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Fig. 2.5. Region R for double integral. 


Subdivide the region R by drawing lines x = Xp Y=Ye,kK=1,2,..., m, parallel to the coordinate 
axes. Number the rectangles which are inside R from 1 to n. In each such rectangle, take an arbitrary 
point, say (¢,, 7,) in the kth rectangle and form the sum 


Jn = 2 f(x. Ne DAA, 


where AA, = Ax, Ay, is the area of the kth rectangle and d, = ./(Ax,)? + (Ay,.)? is the length of 
the diagonal of this rectangle. The maximum len gth of the diagonal, that is max d, of the subdivisions 
is also called the norm of the subdivision. For different values of n, Say MN), M2,...,M,,..., We obtain 
a sequence of sums Dap Sagedess Jim >++ ++ Let n — ©, such that the length of the largest diagonal 
d, — 0. If tim. J, exists, independent of the choice of the subdivision and the point (€,, 7,), then we 
say that f (x, y) is integrable over R. This limit is called the double integral of f (x, y) over R and is 
denoted by 


J= {| f(x, y)dx dy. (2.78) 
R 


Evaluation of double integrals by two successive integrations 


A double integral can be evaluated by two successive integrations. We evaluate it with respect to one 
variable (treating the other variable as constant) and reduce it to an integral of one variable. Thus, 
there are two possible ways to evaluate a double integral, which are the following: 


i> If f(x, y)dy dx = {J Lf (x, y)dy] dx: first integrate with respect to y and then integrate 
R R with respect to x. 


oT «= {| f(x, y)dx dy = {| Lf (x, y)dx] dy: first integrate with respect to x and then integrale 
R R with respect to y. 


Let fbe a continuous function over R. We consider the following cases. 
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Case 1 Let the region R be expressed in the form 
R= {(x, y): O(%) Sys wi), asx <b} (2.79) 


— and w(x) are integrable functions, such that @(x) < w(x) for all x in [a, b]. We write 
( Fig. £-9) 





Fig. 2.6. Region of integration. 


b y (x) 
v= | | | f(x, y)dy | dx. (2.80) 
x=a | y= (x) 
While evaluating the inner integral, x is treated as constant. 
Case 2 Let the region R be expressed in the form 
R={@ )): eO) SxS kh). eS y¥ Sa} (2.81) 
where g(y) and h(y) are integrable functions, such that g(y) < A(y) for all y in [c, d]. We write ( Big. 2./) 
d A(y) 
= | f(x, y)dx | dy. 


y= L= RY) 








(2.82) 






uating the inner integral, y is treated as constant. 


L_= 
a a 


R " sion of integration. | 


2.58 Engineering Mathematics 


. ited in either of the forms give 
: i ck : not be represented in either of t zi Ve] 
n, the region R may be such that it canno nents peaaiied eligi 
E or met In such cases, the region R can be subdivided such i een + meee Car 
Secours in either of the forms given in Eqs. (2.79) or (2.81). For example, 7 aK: — 
drown in Fig, 2.8 and we write R = R, U R, where R;, R2 have no common in Ir points. 


y= W(x) 





Fig. 2.8. Region of integration. 


Then, we have 


{| F(x, y)dy dx = {| I(x, y)dy dx + {| f(x, y)dy dx 
R Ry 59) 


p W(x) : b | py(x) 
=] Uf tera] aes | | sesyvay | ae 2.8: 
a Qi (x) : p 


92 (x) 
In the general case, the region R may be subdivided into a number of Parts so 





that 
m 
{| F(x, y)dy dx = 2 {| I(x, y) dy dx (2.84 
R alge : 
Where each region R; is simply connected and can be expressed in either of the forms given If 
Eqs. (2.79) or (2.81). 
Remark 11 


(a) If the limits of integration are constants (for example, when R is a rectangle bounded by the 
lines x = a,x = b and y=C,y=d), then the order of integration is not important. The integ! al 
can be evaluated using either Eq, (2.80) or Eq. (2.82). 

(b) Sometimes, it is convenient to e 


valuate the integral by chan 
such cases, limits of integration 


ging the order of integration. !" 
are suitably modified. 


Properties of double integrals 
1 If f (x, y) and g(x, y) are integrable functions, then 
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{| Lf (x, ¥) + g(x, y)]dx dy = \| f(x, y)dx dy + \| g(x, y)dx dy. 
oF . 


R 


2. {j nt YIEE ay = k| I(x, y)dx dy, where k is any real constant. 
R R 


3. When f (x, y) is integrable, then | f (x, y) | is also integrable, and 


R 


\| f (x, y)dx dy = {| | f(x, y) | dx dy. (2.85) 
R 


4. \ f(x, y)dx dy = f(¢, mA (2.86) 
R 
where A is the area of the region R and (€, n) is any arbitrary point in R. This result is called the 
mean value theorem of the double integrals. 


If m < f (x, y) < M for all (x, y) in R, then 


mAS {| f(x, y)dxdy < MA. (2.87) 
R 
5. If 0 < f(x, y) < g(x, y) for all (x, y) in R, then 


{| f(x, y)dx dy S \] g(x, y)dx dy. (2.88) 
R R 


6. If f (x, y) 2 O for all (x, y) in R, then 


{| f(x, y)dx dy 2 0. (2.89) 
R 


Application of double integrals 
Double integrals have large number of applications. We state some of them. 


1. If f (x, y) = 1, then {| dx dy gives the area A of the region R. 
R 


See For example, if R is the rectangle bounded by the lines x = a, x = b, y=c and y = d, then 


i, d pb CT i | i 
in a= | | dx dy = | i ts|iy = 0-a) f dy = (b—a)(d-c) 


gives the area of the rectan gle. 
ts y) is a surface, then 


2.12 =f (,) 
es 2) 3: J zdxdy or {J f(x, y)dx dy 
R R 
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gives the volume of the region beneath the surface z = f (x, y) and above the x-y plane. 


For example, if z= 





| | | ah ae ee: 
gives the volume of the eae) x+y t+z2=a,722 0. 


3. Let f (x, y) = p(x, y) be a density function (mass per unit area) of a distribution of mass in the 
x-y plane. Then 


M = i f(x, y)dx dy (2.90) 
R 


give the total mass of R. 


4. Let f (x, y) = e(4, y) be a density function. Then 
ane, = | 7 
=a {] xf(x,y)dxdy, y= MW {| y f(x, y)dx dy (2.91) 
R R 


give the coordinates of the centre of gravity (x,y) of the mass M in R. 


5. Let f(x, y) = p(x, y) be a density function. Then 


| fe {| y* f(x, y)dx dy and 1, = {| x* f(x, y)dx dy (2.92) 
R R | 


give the moments of inertia of the mass in R about the x- 
whereas Ip = I, + I, is called the moment of inertia of the mas 





axis and the y-axis respectively, 
Ss in R about the origin. Similarly, 


all (x-a)* f(x, y)dxdy and I, “| (y — b)* f(x, y)dx dy (2.93) 


give the moment of inertia of the mass in R about 


ft IJ f(x, y)dx dy gives the average value 


of et region R, 


the ks x =a and y = b respectively. 


of f(x,y) over R, where A is the area 


Example 2.41. Evaluat 
uate the double integral | J xy dx dy, where R is the region bounded by the 


x-axis, the line y = 2x and the parabola y = x 


Solution The 
The region 


R= {(, y): (x*/4a) <, 
(ae Sy<2x,0<x<8 
a is given in Fig. 2.9. O< x 8a} 


Nitsa), 


Olnts | | | 
points of intersection of the Curves y = 2x and y = x*/(4a) are (0, 0) and (8a, 16a). 
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| (8a, 16a) 





(a) (b) 
Fig. 2.9. Region in Example 2.41. 


We evaluate the double integral as 


g, 2x 2x 
a $a xy? z 
t= [| xyaxay= [ | xy dy ax = | Ea dx 
9 
R 


0 2 
x2 /(4a) ie?) 











Sa 4 4 6 oa : = 
ee (ee at ee eet S|, oe 
=| 2 (45 aa )e=|5 x | = 4096 |> — agp |a* = GE at 


0 
Alternative We can evaluate the integral as 


l6a | p.f4ay ey ies fay 
i= xy dxdy= xy dx \dy = — yx dy 
0 9 2 
R 


yf2 yl/2 
l6a 
i ae eas ac a 0 WY 
aoe | > 4)" 2| 3 ~ te), 2 





2048 at 
=3, 4. 





f - $2| = 
2 fe | 


2 | 
Example 2.42 Evaluate the double integral {| e* dx dy, where the region R is given by 
R 


R:2y<x<2and0<y<l. 


Solution The integral cannot be evaluated by integrating first with respect to x. We try to evaluate 
it by integrating it first with respect to y. The region of integration is given in Fig. 2.10. We have 


2 x/2 p2 = 
i=] | ay = f yer] ae 
0 0) 0 0 


2 2 
1 2 ie 2 
=3| xe" dx= ae | = (e~ 1). 





2 py*/2 
Example 2.43 Evaluate the integral i} I Z dx dy. 


af x? +y7 +1 
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Fig. 2.10. Region in Example 2.42. 


Solution Because of the form of the integrand, it would Ee easier to integrate it first with respect 
to y. The point of intersection of the line y = 2 and the curve y* =2x is (2, 2). The region of integration 
is given in Fig. 2.11. 





Fig. 2.11. Region in Example 2.43. 


The given region of integration 0 < ys2and0<x< 


v2x <y<2. Hen b y’/2. can also be written as 0 < x <2 and 
ce, we obtain 


[= | ae | = [eT] +] | dr = Piers St va 


v2x 
J fe 
= eT FS Since 


2 


J Bes) ~ dx v? | 
0 
=34+2(In5— In V5) ~ 5 (9 - I) =2In5-1. 





The cylinder x? + z? = ] is cut | 
of the region j cm the first BPtAnE. u by the planes y= 0, z=O0 and Km y, Find the volume 
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Solution In the first octant we have z = ¥1 — x” . The projection of the surface in the x-y plane is 
bounded by x = 0O,x = 1, y= 0 and y =x. Therefore, 


ir ake l - 
v={[ zdxdy = | J V1 — x7 ay arf V1 =x? \[ylg €% 
‘ 0 0 0 


3 


| = 
' | xV1 x? dx = 5 @ = re Se! cubic units. 
0 


2 2 2 
Example 2.45 Find the volume of the ellipsoid a a re = 
a b> ac 


Solution We have volume = 8 (volume in the first octant). The projection of the surface 
we y lee 8 : | a ee : 

ae .h — 7 re in the x-y plane is the region in the first quadrant of the ellipse —~ + re == tle 

Therefore, 


a | pby1-x2/a? 2 wiye “a 
v=s| | Cc 1-4-4 dylax=8e | 
0 0 a b #0 


bk 2 
b2- 2 dy | dx 
0 b? é 


where k? = 1 — (x7/a’). Setting y = b k sin 0, we obtain 


a n/2 wa | a rl 
V= sc | i 4k? — k*sin*@ (bk cos 0) d@ | dx = 8bc | 1 k* cos*6@ 40 ts 
0 [0 | 0 | 


0 
a a) a 
= Abc ( 2] | c ~ © dx = 2896 | (a? — x?) de 
OMe Ne il a 0 


b x? ‘ 47 abc . . 
_2Mbe} ,2,_ 4 | =—— == cubic units. 
a 3 \o 3 


Example 2.46 Find the centre of gravity of a plate whose density p(x, y) is constant and is bounded 


Solution The mass of the plate is given by (see Eq. 2.90) 


M= {J p(x, y)dxdy=k {| dx dy (0 (x, y) = k constant). 
R R 


1 e boundary of the plate is given in Fig. 2.12. The line y = x + 2 intersects the parabola y = x at 
the points (—1, 1) and (2, 4). The limits of integration can be written as — 1 < x <2, x? < YS xv 2. 


vf 


+2 : 5 
ee 
| I 





a 
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Fig. 2.12. Region in Example 2.46. 
The centre of gravity (x,y) is given by (see Eq. 2.91) 


7 | . | 0) 2 x+2 
B= oy [f sec naea 3 [| Payne 
R 


= Bee 


2 , 2 
34 xt 2—aA)de= 5) ex? 2] =a, 
—I —| 








Gas 4 
9 x+2 y) 2 x+2 
y p(x, y)dx d -2f | a ln e2 12 

al A> 9 [PF ve lara? f°] ; 
Lf [( 9)? 4 l (x + 2)? 5 = 
as Ae =r i AX = |) Se 
9 J. \O = 36") il : J 
=] 
=5 [3 4-1)-402+0)]- 5 21 =|=%. 


Therefore, the centre of gravity is located at ( 1/2, 8/5). 
Moment of inertia about the x-axis is given by (see Eq. 2 92) 


t= JJ spt sndedy =e [ ‘a 24 a Ay ‘cs 
‘ Jeuilideow © yee =k | cae dx 


2 
al (+2 aya =k] G49) al 
—l 


(3 _ 423 
2) a = orm 


| sie ee 
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Moment of inertia about the y-axis is given by (see Eq. 2.92) 


2 x+2 2 . 
ly = \| x“ p(x, y)dx dy = k | J dy [as =i | x*(x+2-—x°)dx 
R -1 |? x? “I 


os 


me 2x xe 15 33] 63 


2.6.2 Triple Integrals 


Let f (%, y, z) be a continuous function defined over a closed and bounded region T in IR? . Divide 
the region T into a number of parallelopipeds by drawing planes parallel to the coordinate 
planes. Number the parallelopipeds inside T from 1 to n and form the sum 


Jn = % f (xe Yer ze) AVE 
where (x;, Yg, 2, ) iS an arbitrary point in the kth parallelopiped and AV; is its volume. For different 
values of n, Say n;,N2,...,N,,,..., We Obtain a sequence of sums Dive dances Spe qe as De length 


(Ax,)* + (Ay,)* + (Az,)* . Letn > such that 


im J, exists, independent of the choice of the subdivision and the point (xy, y,, Z,), 
— oo 


of the diagonal of the Ath parallelopiped is d, = 





max d, > 0.If | 


then we say that f (x, y, z) is integrable over T. This limit is called the triple integral of f(x, y, z) over 
T and is denoted by 


J= \) F(x, y, 2) dx dy dz. (2.94) 


Triple integrals satisfy properties similar to double integrals. 


Application of triple integrals 
1. If f (x, y, z) = 1, then the triple integral 


Ver ff dx dy dz (2.95) 
T 
gives the volume of the region 1 i 


2. If f (x, y, z) = p(x, y, z) is the density of a mass, then the triple integral 
M = {fj f(x, y, z)dx dy dz (2.96) 
T 


X= 4 {VJ xf(xy,z)dxdydz, y= 4 {fi yf (x, y,z)dxdy dz, 
t T 


tn, {iJ ef (% y.2)dx dy dz 
Me de, (2.97) 
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ee aferavity) of the solid of mass M in 7 
‘ve the coordinates of the centre of mass (or the centre of gra\ ity) 
sive the Cor ates ce ae ne 
heeft y ZS P(X Ms z) is the density function. 


2. 72) f(x y. zjdx dy dz, 
| ? iB as\irAavaZ | (x 5 ae ) f (x y, Z)4.- . _ 
= y2 +22) f (x, y, Zax dy 42, f il} 
4. Pe {|| Re 


T 


i, = {jj (x2 +y2) f(x, y, z)dx dy dz 


T 


(2.98 

; ot 5 d z- 

inertia of 1S t the x-axis, y-aXx1S and < 
give the moments of inertia of the mass in T abou 


axis respectively where 
f(x, y,z) =p, y, z) is the density function. 


Evaluation of triple integrals 


We evaluate the triple integral by three successive integrations. If the region T can be described by 


x, SxSx, yi) Sy S yor), 1A y)SzS Z2(x, y) 
then we evaluate the triple integral as 


Xp pyg(x) ez2l.y) + | wes 
| | flay 2)dedyax= | | : 
XY 


z(x,y) ib 
| | f(x, y, z)dz |dy |ax (2.99) 
y (x) z(x,y) x] y,(x) ul 





z(%y) 


We note that there are six possible ways in which a triple integral can be evaluated (order of variables 
of integration). We choose the one which is simple to use. 


Example 2.47 Evaluate the triple integral WW y dx dy dz, where T is the region bounded by the 


T 
surfaces x = y’, x =y +2,4z=x*+ y’ andz=y+3. 


Solution The variable z varies from (x? + y*)/4 to y + 3. The projection of T on the x-y plane is the 
region bounded Py the curves x = y* and x = y + 2. These curves intersect at the points (1, -1) 
and (4, 2). Also, y’ Sy + 2 for -1 < y < 2. Hence, the required region can be written as | 


-l<y<2, y?<x<y+2 and [x* + y*\/4] <2 <y 43. 
Therefore, we can evaluate the triple integral as 


2 y+2 [ @(y+3) | 3 
=] J | dz\d = ‘it te ay? | 
‘| y? (x2 +y2y/4 : ha Si liws2 yt aes aoa ax ay 
f ( y3 ae y+2 
= Ee ay We 
eI ie : | 12 | : dy 
: y 





a iG ys 
ee : : 
ies sa. lee 
\( y F\OF2~ 5%) 1 yy 429 -¥ ay 
= re ay? 
ae 


Nae 16 
3 2y $A? a 
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| 42 
she und’ 4°... yt. ay? Sy 
ee IS el ee ae ie 


Example 2.48 Ff valuate the integral ill z dx dy dz, where T is the region bounded by the cone 


=x’ tan? a + y* tan*B and the planes z = 0 to z =A in the first octant. 
Solution The required region can be written as 


Osz< 4x? tan?’a+ y* tan’B, 0<<Whk x tan’a)cotB, O<xShcota 
: f 


Therefore, 


h cot a@ (af h2 — x? tan2a@ )cot B 


7 (x* tan?a + y” tan” B)dy | dx 
0 


0 


h cot o 1 
= - | ne —x* tan7a)'* tan*a + 5 (h? — tan? or)? | cot B dx. 


Substituting x tan @ = h sin O, we obtain 


t 
y= oot 





m2 
| A? sin?@ (h cos @) + = (h cos*6)| h cot acos @d@ 
0 


| n/2 , | 
= 5 h*cot Bcot a | (sin*@ cos*@ + ‘ vos 0). | 
0 


m2, 
s 4 h*cot B cot a 1 (sin?@ — sin*@ + a es. 
0 


; aie EG O 
= 5 h*cot Bcot a a - 2 + +z|=4 4 cot acot B. 


Example 2.49 Find the volume of the solid in the first octant bounded by the paraboloid 


Z = 36 — 4x* — 9y’. 
= ! dz dy dx 


Solution We have 
The projection of the parsboloid (in the first heh in the x-y plane is the region in the first quadrant 
of the ellipse 4x” + Oy” = 36. 


Therefore, the region T is given by 
0<z<36-4x°-9y*, O<y< 


| 
es) 
CN 
| 
= 
a 
re) 
© 
lA 
+ 
lA 
tu 
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c - x*/3) 


V= (36 — 4x? — 9y* )dy |dx 


“0 0 


j j CE ee a ile aa 


0 
a0 32 8 2 3/2 16 ng? 7 ar. 
J0 


Substituting x = 3 sin 0, we obtain 


mi2 /2 ’ 
y= (27 cos*@)(3 cos 0)d@ = 144 | cos"@d@ 
0 0 


| 4 | 2 
= caer SS eam | cubic units. 
= 144 (S 5 4 270 


Example 2.50 Find the volume of the solid enclosed between the surfaces x2 + y’ = a’ an 
v4 2=a?. 


Solution We have the region as 


—Va* -x? <z< Va =x, = Va’ — x2 <y< va? — x? —~@SXSa- 
ff 


a 


Therefore, ~S/ 


4 ABER? nhagt feed ae 
v= | | | de dy ds = 8 | | Nate dvd 
— ~ya2 — x2 She 0) 0 ‘ - a 


a i a 3 
= | (a* —x?)dx =8 (a2, = =| = 1027 cubic units. 
0 0 





3 


2.6.3 Change of Variables in Integrals 


b 


In the case of definite integrals J (x)dx of one variable, we have seen that the evaluation of the 


él 
y using some substitution and thus chan 
ple integrals can be evaluated by using s 


integral is often simplified b 
Similarly, the doyble and tri 
the variables of integration. 


ging the variable of integration. 
ome substitutions and changing 


Double integrals 


Let the variables x, y defined in a region R of the x-y plane be transformed as 


X=x(u,U), y = y(u, v). (2,100) 


We assume that the functions x (u, v), y(u, UV) are defined and have continuous partial derivatives !" 


DEE '"~S OO 
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. oe ’ . . 
the region R Coen est in the u-v plane. We also assume that the inverse functions u = u(x, y), 
y = v(x, y) are defined and are continuous in the region of interest in the x-y plane, so that the mapping 


is ene ONE: eee the function f (x, y) is continuous in R, the function f [x(u, v), y(u, v)] is also 
continuous in R*. Then, the double integral transforms as 


\] I(x, y)dx dy = \| f[x(u, v), y(u, v)] | J| du du = {| F(u, v)du dv (2.101) 
f F 


otiaee j= O(x, y) _ Ox/du dx/dv 
A(u,v) | dy/du dy/du 

is the Jacobian of the variables of transformation. 

For example, if we change the cartesian coordinates to polar coordinates, we have 











x=rcos @, y=rsin@, n<r<nm, 4<O0<O 


cos 6° —rsiné@ | 


sin | poos@l (2.102) 





-dx/dr dx/00 : 
dy/or dy/de| 








Therefore, 


R 
Where R* is the region corresponding to R is the r-@ plane. 


{| f (x, y)dx dy = {| f(rcos 8,rsin @) rdrd@= {| F(r, 0) rdrd@ 
R* R* 


Triple integrals 
Analogous to double integrals, we define x, y, z as functions of three new variables 

x=x(u, VU, WwW), y= yu, V, Ww), Z= z(U, V, W). (2.103) 
Then 


7 


{| f(x, y, z)dx dy dz = {| flx(u, v, w), yu, Vv, Ww), Z(u, Vv, w)) | J | dudu dw (2.104) 
7 ) T™ 


Ox/du dx/dv-~—s ax/ dw 
where J= sane =|dy/du dy/dv_ dy/dw 
ee! Aziou “deldve \ azidw 





is the Jacobian of the variables of transformation. 
For example, if we change the cartesian coordinates to cylindrical coordinates, we have 


x=rcos 6,y=rsin'@ 2—2 


dx/dr ax/d@ adx/dz cos@ -rsing 0 
y= | ay/or dy/0@ ody/dz| =| sin @ reos@ O|=r (2.105) 
dz/dr  oaz/dd dz/dz 0 0 lui 


{fJ F(X Y> z)dx dy dz = {J f(rcos 0,rsin @,z) rdrd@ dz 
ne 7 
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: s ; : — 7 1 3 ' 
If we change the cartesian coordinates to spherical coordinates, we have (Fig. 2.13) 


a . " < <4 
x=rsin Ocos @ y=rsin sin 6, z=r cos 9, O0<@<2m7, OF OS7 


idx/dr dx/d@ ax/d@ sin@cos@ rcos@cos@ —-r sin @ sin 6 
J=\ay/ar dy/de@ dy/dO|=|singsin@ rcose? sin 0 rsin @cos 6 
dz/dr dz/dd dz/d0 cos @ —rsing 0 
= cos o[r sin @cos ¢cos7@+ 7° sin dcos ¢ sin-9]+rsin o[r sin-@ cos-@ + r sin“ sin*@) 


(2.1 


= r*[sin @ cos7@ + sin?¢] =r’ sin ? 


and \| f(x, y, z)dx dy dz = {| F(r, 8, 9) r*sin @dr dO dQ. 
T Ba 





Fig. 2.13. Spherical coordinates. 


E le 2.: | the 1 : | : 
xample 2.51 Evaluate the integral {| (a* — x* — y*) dx dy, where R is the region x + y" $4 


R 
Solution We can evaluate the integral directly by writing it as 


4 ince 
[= 2 2 
if = 5 (Coa — y*)dy dx. 


However, it is easier to ev > j 

LOWEVET, It is r to evaluate, if we change to r : inate 
er ks 9 AE We Cli Olar coord ate’ 
to polar coordinates, we have (see Eq. 2.102) : te eeosian coor’ 


SF COMO. y= r'sini'O, J =. 
Therefore, 


a pln 
— yl (a r )rdr d= J I, 40) (ar Pyar 


Functions of Several Real Variables 2.7) 








ad 

a | pH By ANA 4 
zy an | (a*r - r\deo ope) 2 

0 | fu A = : 


Anos 2.52 Evaluate the integral \| (x — y)* cos*(x + y)dx dy, where R is the rhombus with 
R 


successive vertices at (7, 0), (27, 7), (x. 27) and (0, 72). 


Solution The region R is given in Fig. 2.14. The equations of the sides AB, BC, CD and DA are 
respectively 


X-YV=N, X+y=3nm, x-y=-—M and x+y=T. 


C (7, 27) 





A (7, 0) 
Fig. 2.14. Region in Example 2.52. 


Substitute y—x = uandy+x=vU. Then, —-wS usa and mS<u< 37. We obtain 
x=(v—u)/2, y=(u + w)/2 


|dx/du  ax/du | % =i if? yry 


ICE Win 1 ieee 
dy/du dy/dv 1/2) 2 2 


and die 








Therefore, 


3m pT 
j= {] (x — y)* cos* (x + y)dx dy = * | | u*cos*v du dv 


3m 3 fez 4 
== | cos? du = = | (1 + cos 2v) dv = =. 
5 t 7 





Example 2.53 Evaluate the integral \) Ax? + y* dx dy by changing to polar coordinates, where 


Ris the region in the x-y piane we avian by the circles x? + y? = 4 and x7 + y* = 9. 
Solution Using x=rcos 9 y=" sin 0, we get dx dy=rdrd@, and 


| 2 3 3 2% 
fiz “4 " rerdrdoy= | | a= 12 | do = 232 
a J, Seep eo 
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, ike ay | 7 where 7 is the hemisphere of - 
: -valu the integral! || zdxdy dz, W 
Example 2.54 Evaluate g 
rT 


r+ +2=a’,z20. 
Solution Changing to spherical coordinates 
0<@< x72 


— . 


7 ns ee = » 0<6<22 
x=rsin dcos 6, y=rsin @sin 8, z=rcos¢, 0< 8< 27% 


we obtain dx dy dz =r sin @ dr d@ d@ (see Eq. 2.106). Therefore, 


 pIx gzf2 
21 {2 a _4 — : 
i= | | | (r cos @) r*sin @dr do dO = = | | sin 9@cos 0dod 
0 40 #0 9 40 


4 20 mif2 4 27 COS 20 qFl2 s a* ¥ Tae 
ee - jee ey | —— d§ => a0 = —— 
= I | sin 290 d0d6: 3 I 7 I g J. Z 


= 





Example 2.55 A solid fills the region between two concentric spheres of radii a and 6.0 <2< 
The density at each point is inversely proportional to its square of distance from the origin. Fir 
total mass. 


Solution The density is p = k/(x* + y* + 2”), where k is the constant of proportionality. Therefor 
the mass of the solid is given by 


M = [J p dx dy dz = If ee a gy 
J a ty 40287 
T 


T 
where a* < x * + y’ + z* < b*. Changing to spherical coordinates, we obtain 
x=rsin @cos 8, y=rsin@sin 6, z=rcos ¢, 24 ¥+2=r, a<r<b 
dx dy dz=r° sin o dr dO dd, 0< O< 2m, O<o<7 


Therefore, 
2m 1 b 
Fel |. 
() /(0) a 


| 20 2% 
= k(b -a) ) [—cos 9]5 dO = 2k(b — a) | d0=4zk(b 
| 0 





r-sin o 2 px 

2 dr do dO = k(b — a) j I sin @d@d@ 
2). 
2.6.4 Dirichlet Integrals 


Let T be a closed region in the first octant 


in IR’, led es . , tefcy = } 
and the coordinate planes. Then, bounded by the surface (x/a)? + (y/b)? + (z/c) 


an integral of the form 


<= {[f xO PI 21 dxdydz 
T 


is called a Dirichlet integral, where all the constants a, 8 
Positive. i 


(2.107 


a, b, c and p, q, r are assumed to & 


| p " i 2 * - “) 
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We now show that 


l= {If x Fly Bp Loy | dx dy dz = at*bP et P(alp)T(Biq) i (y!r) (2.108) 
J. Ts ) | 
’ Pp q r 


x \? y q 2 r 
Let =] = u, (=| =U, (=) =W,orx= aul? y= bu'4, z= cw’. 


The Jacobian of the transformation is given by 


Ox/du dx/dv = ax/dw (al pul?) () () 
j= dy/du Ay/ du JOy/dw = 0 (b/g)? 0 
Oz/du dz/du dz/dw () () (clrywr- 


= ADE i p)~\yVa)=1 r= 
pqr 


and dxdydz = |J| dudvdw = 226 y/r)-1y/a)-l WN du dudw. 
pqr 
Now,x20,y20,z20 gives u2>0,v 20, w 20 respectively. 


Hence, we obtain 


—| 5 i— : 
Te Ml [ au?) |" [bua |? few) om yp )-l yy (/q)-1 (Ir) -1 dududw 
R 


= Aor cr {y w@/P-yBa-lyY/)-| du dydw 
par 
R 
where R is the region in the uuw-space bounded by the plane u + v + w = 1 and the wu, vw and uw 


coordinate planes, (Fig. 2.15), that is, R is defined by 


O<swsl-u-v, Osvsl—-u, O<uK<il. 





Fig. 2.15. Dirichlet integral. 
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Therefore, we get 


[= ee | [. —— (a/p)-1 y(Bla)=1 WO =l dududw 
u=0 “v= 


l-u-v 
hee cn pcBlay-1} wo wir) dudv 
~u=0 7) jy 


atbPor 


wit f l° ybPr-l y(Blay-l () — yw — vv)’ dudv 
Pqy w=0 


Substituting v = (1 — u) t, dv = (1 — u)dt, we obtain 


a b8 y fi M “i re 
fa Se | | yi e/p)-1 (= u)'Bla)+(y/r)) t(B/q)-1 Ch = ry") dudt 
Pqy =0 #/=0 | 


Since the limits are constants, we can write 


= £0 | CGP) (yy BIa) +r ay | ¢(Bla)-1 (yp) (!7) ay 








ol 


bry 


Functions of Several Real Variables 2.75 


= a“bP oY I(alp)I'(B/lq)l(y/r) 
rare $$ 
r{ 2 + i + le + 7 
P q iF 


which is the required result. 


Example 2.56 Evaluate the Dirichlet integral 


ik {ff x? y3z3dxdydz 
mi 


aa I is the region in the first octant bounded by the sphere x? + y* + z” = 1 and the coordinate 
planes. 


Solution Comparing the given integral with Eq. (2.107), we get 


Q=P=y=4,p=q=r=2,a=b=ce=l. 
Substituting in Eq. (2.108), we obtain 
Le ae 
(7) 


I = —— 
8(6!) 5760 
ince I’(n + 1) =n!, when n is an integer. 





xample 2.57 Evaluate the Dirichlet integral 


= i} 2 yi? 2M? edydz 
T 


Where T is the region in the first octant bounded by the plane x + y + z= 1 and the coordinate planes. 


Solution Comparing the given integral with Eq. (2.107), we get 
C= B= V= 3/2. p—G=rT=la=—=b=¢= |. 
Substituting in Eq. (2.108), we obtain 
ae Le Gir 
Py 
Using the results, F(a + 1) = @ I (@) and (1/2) = V7, we obtain 


~ (0/2) 0 /2))° 47 


= BPH CTDGIDGID ADF UD ~ 945 


Exercises 2.5 
we ny, Find the area bounded by the curves y = x y=4—32 


. 2 ae. Find the area bounded by the curves y= 4 — 2x,x>0, y>0. 


> 
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4. 


5. By changing to polar coordinates, 


Change 


10. 


11. 


12. 


Vee 


14. 


15. 
16. 
17. 


18. 


19, 


20 


z 


21 


22 


23. 


aes 


26. Find the volum 


27, 


Find the area bounded by the curves Puay,x=y. 


ele wipe De = Ay ~. 
find the area bounded by the curves x + y 2y,xX +y y, x 


and x = 0. 


: ible integrals. 
the order of integration and evaluate the following double integ 


l y+4 9) 1 

, sy + 

/ e y dx dy | 7. {| 7 dx dy. 
c = xs=\ 

DONE yoo ly? + y? y 





| 2 x7/2 | 

1 pn of [eon 
; | | e* dx dy. A Whe oe fx? +y? +1 

y=0 *x=y 


: l-x rae | d = uv) 
| | e”(**¥) dy dx (use the substitution x + y= 4 and y = 
x=0 # y=0 


Find the volume of the solid which is below the plane z = 2x + 3 and above the x-y plane and bound 
by y’ =x, x =0 and x =2. d 
Find the volume of the solid which is below the plane z = x + 3y and above the ellipse 25x* + 16y* = 4( 
x20,y20., 


Find the volume of the solid which is bounded by the cylinder x ? + y’ = 1 and the planes y + z= 
and z= 0. 


Find the volume of the solid which is bounded by the paraboloid z = 


9 — x* — 4y” and the coordina 
planes x > 0, y>0,z>0. 


Find the volume of the solid which is enclosed between the cylinders x* + y* = 2ay and 7 = 2ay. 
Find the volume of the solid which is bounded by the surfaces 2z = 


x’ + y* and z= x. 
Find the volume of the solid which is 


bounded by the Surfaces z= 0. 37 = 2 and the cvlind 
Oe aa y z= 0, 3z = x* + y? and the cylin 
Find the volum i ich is j Sant . —— 
eee : es ume of the solid which is in the first octant bounded by the cylinders x7 + y? = a’ an 
Find the volume of the solid which is bounded by t | id : - 
and the cylinder x? + y? = 2 x. ¥ the paraboloid 4z = x? + y’, the cone 27 =x +) 
Find the volume of the solid which j ha tioht x: : 
and x+y = 1. 1s Common to the right circular cylinders x2 + 2=l,y+7= 


Find the volume of the solid whi 
2 


¥+ y+(-aPagq 


Find the volume of the solid which ; 

: | vhich is belo : | 
oo ae Shae mie Ww the surface z = 4x? + 9)? and above the Square with verlice> 
Find the volume of the solid which is bo 


ch is above the cone z* = ,2 


+ y* and inside the sphere 


unded by the Paraboloids z = x2 4 y 


; is bounded b 
Find the volume of the soli ne aa vy 
at. ntained between the 


and z=4- 3(x? + y’): 
+z = Va and the coordinate planes. 


cone 2 = 207 + y?) and the hyperbolo! 

es € of the regio | 

OS O< m/4. sion under the cone z = 3r and over the r 

Find the volume of th 

ate Oo € Portion of the unit 

Vertex at the aric; : Sphe in] eg ee 
ertex at the origin and making an angle q - “ee rae inside 

| e Z-axis. 


Ose petal with boundary r = sin 44 


the right Circular cone having '* 
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28. Find the volume of the region under the plane z = 1 + 3x + 2y, z= 0 and above the region bounded 
by x= 1,x=2, y=x’, and y = 2,2 
29. Find the volume of the portion of the sphere x2 + y2 + z” < 2ay between the planes y = 0 and y = a. 
30. Find the moment of inertia about the axes, of the circular lamina x? + y? <a”, when the density function 
is P=Jx* +y?. 
31. Find the total mass and the centre of gravity of the region bounded by pos ye =a”, 
x20, y 20, when the density is constant k. 


: 2 dx dy 
32. Show that [= {| ayy h integer, R: x* + y* > 1 converges for p > 1. 
R 


Hence, evaluate the integral. 


Evaluate the following integrals (change the variables if necessary) in the given region. 
33. {| (x* + y”)dx dy, boundary of R: triangle with vertices (0, 0), (1, 0), (1, 1). 
R 


34. {| x* dx dy, boundary of R: y=x*, y=x+2. 
R 


35. {| (x? + y*)dx dy,R:0<y< Vl—-x? ,0<x<1. 
R 





| i x? y? 
36. ary pa a) ono 
R 


37. [[ eer? aed, ei Pe yP24 P9525, yon x20,y20, 
R 

38. [[ Pracd, Rite yest x20 y20 
$ 

39, [[ raed. e: V+ Wo = Vax 0920 


ag JJ ee 2 1422)» Downey of X; (he. square with vertices (£1, 0), (0, 1) 
i R 


(ct ange COOr dinates: x-y=u,x+y=v). 





7 at. ed pa os sy . : , . . 
ast. | (x + y)? dx dy, boundary of R : parallelogram with sides x + y=l,xt+y=4,x-2y=-2, 


y 
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43, \| xy dx dy, region (in polar coordinates) R : r= sin 20,0 < 6s 7/2. 


R 


44. \)) x*y*zdxdydz,T: x+y" <1,0<z1. 


dx dy dz ; 
45. , boundary of 7: x= 0, y= 0, z= 0, x+ yt z= 1. 
bie rere he ia fon al ; ; ani: 


46. 


> 


{I (x+3y—2z)dxdydz,T: 0<y<x7,0<zsxt+y,0<xS1. 


47. 


— 


[J | s4:dvde, boundary of Ti y=x, y=x4 2, 4z=x°+y’,z=x+3. 
48. {| (2x-—y-—z)dxdydz,T:0<x<1, O<9=37 0<7s x+y. 
T 


49. ee b ) DD! 1 Sens 
a Gee: oundary of T: x° + y°+ 2° =a", x*+y?4+72=b2 a>b. 


50. 


= 


Bios scsi gay + y, x+y" +27 = I. 





51. 1-4 -5-5 2 
IJ] Zi 73 dx dy dz, boundary of T : X— : te =]. 


32. fff fx? + y? + z* dx dy dz, T: x? + y? + Zty) 
T 


33. If (2 +y)ded enh te as 
Ly, * }dx dy dz, boundary of T : Die) is 7 
f he Piet SM a a I and the coordinate planes. 


> 


54, 


{ff (y* +z? )dx dy dz, boundary of T: y?+ 2<@2Q<;< h 
r a" 







aluate th > following Dirichlet integrals. 


56. ||| xyzdxdydz, T: Region | 
ee ed by x + y+ z= 2 and the coordinate planes. 
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57. {II xy?z? dxdydz,T: Region bounded by x + y + z = | and the coordinate planes. 
Ot 
58. ll xyz dx dydz,T: Region bounded by xr + y +z? = 8 and the coordinate planes. 
oF 


59. ill xy'*z dx dy dz, T: Region bounded byxt+y+7e=l1. 
T 


f 2 
60. \\] x*y dx dy dz, T: Region bounded by = + = + a = 1. 
L 


2.7 Answers and Hints 


Exercise 2.1 
1. | f(x, y)-—11l=l@-1¥% + G- 1) + 2@-1) + 20-D! 
2\e—1. 2+ pit Foley ilee 
(i) if|x—11<6,ly—11< dis used, we get 26° + 46< €or b< [/(e+ 2)/2 - 1] 
(ii) if 6* < dis used, we get 6< €/6 
(iii) if (x — 1)? + (y— 1)? < & and| x-11<6,| y—11< dis used, we get 6< Ver e=7%, 


2. \f @ y)—71=1@-2)-@-1)P + 6@—2)-20- 1) 
Bix 2 Pe lye TPs Ole <2 12 y=1 bee 







dix —21< 6, ly-1 | < Sis used, we get 26° + 86<¢, or d< (e+ 8)/2 -2. 
mt | (i) if é°< dis used, we get o< e/ 10. 










Gi) if @- 2)? + (y — 1)? < 6° and| x-21<6,ly—11< dis used, we get d< Je+16 — 4. 


a | fe — 
=! = 2, 
m ies ery ia 1| 


4, Lets J p= rie eas @, } die r sin 0. Therefore 


=; 


<lxtyl<laltlyl< 2yx?- +y2 <e Take d<e/2. 





+e ee Take 6 < e€/2. 


| ° ~— "ee = 
Se aro y)-0 ai ie +lyl< 2, < *a5 <€ Take 6< é/2. 


= 2 et) 39 
ie as 
a a). 
ST] 


12. ]i, 


16. 
17. 
18. 
19. 
20. 


- Letx=rcos @ y=rsin@; — 


| cos’@ =) _» cas r > 0. Limit does not exist. 
Sarees =a ae 
cos?@+ sin’ @ 


Choose the path y = mx*. Limit does not exist. 
Choose the path z = x*, y = mx. Limit does not exist. 
Choose the path y = mx, z = mx. Limit does not exist. 


Choose the path z = Vx , y= mx. Limit does not exist. 


Choose the path z = 0, y = mx. Limit does not exist. 











21. Choose the path y = mx. Discontinucus. 
22. Limit is 0 for x > 0 and 1 for x <0, Discontinuous. 
23. Discontinuous, 24. Choose the path y = mx. Discontinuous. 
25. Choose the path y = mx. Discontinuous. 26. Cancel (x — y). Discontinuous. 
27. Letx=rcos 6, y=rsin @. Continuous. 28. Choose the path y* = mx. Discontinuous. 
: 7 7 1 ] | sin 4/ Ixy] = J ly! | 
29. Since x“ +y*>2|x| Lyi we have ———__- < > therefote; | f(x, yyIl< : : J 
it toys 21 xy V2 | xy! 
Continuous. 
30. Since 2 < 3 + sin x < 4, we have [1/(3 + sin x)] < 1/2. Therefore, | f (x, y) | < [(2x2 + y’)/2] < x? + y-. 
Continuous. | 
31. The function is not defined along the path y = — x. Discontinuous. 
xo =p Fes) esd (x? + y2)5/ +(x? + 2 5/2 
32. 2 =p | = = 9 > S , : Continuous 
x +y* x* + y* x? + y? : 2. 
33. 


34, 
35. 


Function is unbounded in any neighborhood of x = — |. Discontinuous. 


Since | xl, 1 y |, 1 zl are all < VP etVet seal fl < je? 207 


Continuous. 
The function is unbounded along x = 


V¥3z- Discontinuous. 


Exercise 2,2 


I. f,(0, 0) =0, £0, 0) = 0. For (*, y) # (0, 0), find f,, f. 


2. f(x, y) is unbounded as (zy) => 
3. f.(0, 0) = 0, f, (0, 0) = — 1, f.(0, 
4. JO, 0) = 1, f,(0, ()) =. kk dz = 


5. fr, 0) =0=£,(0, 0), de =0 


No contradiction since continuity of f 
In problems 6 to 15, f. 


as (x, y) > (0, 0). anc’ choose the path y= mx. The limits do not exis! 


(O, 0), for example along x = yy: 


(0, Q) — Eo, 0) == i 
y) = 0, f,, 0) = 1. | 


Ax + Ay, jim, (Az — 4z)/Ap) does not exist. 


- Jim) [(Az ~ dz)/Ap) = 0. 


fy is only a sufficient condition. 
» fy and f, are given in that 


Order at the given point 
6. —_ ea 2. | 


8. 6e'?, de!” 
10. = 


A. 1 2e 173, 


9. 49/(85)3?, _ 49/(¢5)32 
1/10, ~ 1/10. (859. 
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11. f(y) = 21n [J x? +y* —x]-—2 In y, —2/5, 3/10. 
12. — 2/27, — 1/27, — 2/27. 


13. e¢, —2e, e. 
14. 5, 3, 0. 15, 1/7, 3/35, 4/35. 
16. 0. | aie 


18. e*[sin (y + 2z) + (41° - 1)?} cos (y +22]. 19. Ay+z)t+ (tz) (t+ Det+ (ety) (1-de". 


20. (7/2) — (2/7). 23. Sets=x-y,v=y—Z,w=Z-x. 


31. — [yx?™' + y*In y)/[xy*! + x In x], 32. y/[x + 3y’Q? + y’)]. 


33. | =~ se) _ _ y(sin xy) + z(sin xz) (=) ted soe. | x(sin xy) + z(sin yz) 
y | ‘ 











Ox dfldz y(sin yz) + x(sin xz)’ Oy 0 fldz yt y(sin yz) + x(Sin xz)” 
(= __(9flox\ _— 3x*+3y+3z (dz) _ (dfldy\) _ 3x-4y 
34. | Ox : dfldz} — 3x+2z " \dy). \dfldz) 3x4 2z 
35. Let u=z/y, v = x/y; then f (u, v) = 0; x. 36. 499.6. 
37. 4.02. pee SS) fie | 
38 ae l+ ey ev3i+1)). 
39. 1.81. 40. =a~ [180 + 2(6 - ¥3)] = 0- 2686. 
41. 5.01. 42. V=nr°h/3, dVidt = 852/72 = 3.71 fP/hr. 


43. § = 2(xy + xz + yz), max. absolute error = 2880 in*, max. relative error = 0.0766 in. 
percentage error = 7.66%. 


44. A= eS sin @ , percentage error = 13.7%. 
45. V = abc, percentage error = 3%. 46. V=ar°h, percentage error = 9.2%. 
47. 121.6 watts. 48. 2.92%. 49, 29.33%. 


50. Lateral length / = Vr? + h?, lateral area = rl, dr =r/100, dh =h/100, di = J (dr)? + (dh)? = 1/20, 
percentage error = 2%. 


Exercise 2.3 
. At (1, 1): fo = — V/2s fy = % Sy = 12. 
BAL 2) 3): fee = Oh Fey = 9 Soy = — V9» Sy = 27. 
3. At (1, 2): fer = 9, fey = 1s Sy = — 34. 
4. At (1, 12/2): feo, = € In (0/2), fery = elm) +1, fyy =— 4e/m*, fry = 16e/7’. 
5. At (2/2, 1): fee =— & Sy = Ol 2s Sy = - mel. 
» At (1, -1, 1): fee = — 2s fey = — V4 Se = — WA, fy = 0, f,, = -1/4, £, = 0. 
» Atl, 1,1): fx = 66°, Say = ~ 40» Sea = 40° Sry = 6", yz = — 40°, f,, = 60°. 
B. At (1, 2/2, 1/2): fx = —0°12 Sry = — 712s fra = — M2, fry = — [1 + (127S/4)], fy, = — [(0°8/4) - cl, 
fee = — [1 + (77S/4)], S = sin (7/4), ¢ = cos (17/4). 
9. At (1, 2, 3): fer = 9 Sy = — M4 See = — Le Sy = 14, f,. = - 1/9, f, = 4/27. 
10. f,, =f In (ex) In (ey). 


— 


a A 
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rh 
oO 
1S 


0) = 

= x, f(0, 0) = 1s fx, 

LL. f(0, 0) = 0,f(0, 0) = 0 5(0, 9) = 0.40% 9° le y) = fy y) = — yl? + y?)3/2 
: yex! In x). en 

12. fy =f Yar CU +y 


x+y" 


15. 4(1 + 2y*)z @ 
14. (1 + xy) (cos ze”. 

16. For t= 0, we get x = 0, y= 0, dz/dt = — 72. ; See sin bun? 
17. Ox/du = 3u/x, dy/du = 5uly; dx/du’ = 3(x° -— 3u yx", y Ay. 2-16. 

18. Forx=1, y=-1,z=2, we getu=4; lv =2; (Quldx)y,z = 9/9; (OVI CY) x2 = 


9. 2. > ot ee g 


dk View de 1 dea 
20. dy/dx = (e — 1)e + 1), d?yldx” = 2(e” + Ile + 1). 





x? [22 ; 


21. = =u" (v/u)" In(ex), = = u’'[1+v(n eu)’ J. 
Ox ae 


26. @= 3f or a= 4B and B # 0 arbitrary. 


27. Note that u? + u? =v2 +? = I(x? +y")?, uy, + Uyy = 0 = Vy + Vyy. We have 


xx TF Zyy = = fi Ux t Uyy) + fy ( Ux, F Vyy) + Ti (u2 + us ) efi (v? F Uy). 
28. Use x* + y? =r’, @= tan“'(y/x) and differentiate. 


29. sinu=(x? + yx + y) isa homogeneous function of degree 1. 


30.. e = [4 x* —y*/x] is a homogeneous function of degree 0. 
31. u is a homogeneous function of degree 1. 32. u is a homogeneous function of degree |. 
33. w= tan u is a homogeneous function of degree 2. 

34. f(%, y) = 6 — S(x - 2) + 3(y - 2) + (x 2)? + 3y — 292. 

35. f(x, y) =-2-2@-1)-(y- 1); B= 4;| E| < 0.08, 

36. f(x, y)=(x- 1) + y; B= 4.6912: |E| < 0.0938. 


CLEANED) yeaa Wy tee ye 1) + &— 1)); B= 5.1; | E| < 0.002 


38. f (x, Deis 4 e-tae- 3)] - — 


rly 2 4), 
| E| < 0.64 x 10-4, eq > 1) * 2 — 1) & - 3) + (y - 3)%J; B= 0.014 


$C Na1+ Qx+y)+ 2 x+y? + 2 (2x4 yy} B= 23.87; | E} 
S 0.008. 
40. f (x, y) = - F ws ayy. 
L(y) = (+ 2y)— & (x+y)? B= 16 [sin(0.3)] = 4.723. \E1<0315 x 103 
= ’ I. x 10, 


a seon= be He 8). ) | & 
| t/| 4 4 #af 22 


— It at peli 
aie Pe a(-17 


Dk B = 0.3872. | E}<0.017. 
43. f(y, 2) =34 2 (x- +2 (y- 4).42 ( 3 
a 55 


t}e = 0.3985; | E | < 0.0179 


Ad £1 - 2 
42. f(x, y,z) =3+ 3 Ie = 2) += 2) 4 @ 





44. 


45. 
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f%yW=xX+ytxz+yz;B= l.11; | E| < 0.005. 


2 Ne ae 
f@YyoD=1+x + fa = (y= 1? -(2-4] —fi(y- »(<-)} | B | = 7.0817; 


to] — 


| E| < 0.0319. 


Exercises 2.4 


I. 
3. 
>: 
7. 


oo 


minimum value 9 at (3, 1). 2. maximum value a at (0, 0). 
minimum value 0 at (0, 0) BE Bl 


minimum value 5(2)~”° at (+ 23/19, 2-5). 6. minimum value —3/2 at (7/3, 27/3). 


The matrix A or the matrix B = — A is not positive definite. The function has no relative minimum or 
maximum. 


4. minimum value (3)*? at (3°-'%, 3-"”) 


. The matrix B = — A is positive definite and fix, fy» fez < 0 at (0, 0, 0). Maximum value is 0. 


9. A is positive de‘vinite and fe+.Syy» Sez > 0 at (-1,-1,-1), (-1, 1, 1), (1, -1, 1), (1, 1, -1). Minimum value 


10. 
ll. 


12. 


13. 


14, 


is —1 at all these points. 


B = — A Is positive definite and frxs yy» fez < 0 at (W/3, 1/3, 1/3). Maximum value is (log 3) —1. 
No relative maximum and minimum. Absolute minimum value — 3 at (0, 1). Absolute maximum value 
3/2 at (++/3/2, -1/2). 

No relative maximum and minimum. Absolute maximum value 1/2 at (1/2, 1/./2 ) and (-1/./2 2D): 
Absolute minimum — 1/2 at — 1/2, 1/2) and (1/2, — 1/2). 

No relative maximum and minimum. Absolute maximum value 13 at (9/V13, 4//13). Absolute 

minimum value — /13 at (— 9/4/13, — 4/13). 


Relative minimum value 3/4 at (1/4, 0). Minimum value 3/2 on the boundary at (1/2, + 1/-/2 ). Absolute 
minimum value 3/4 at (1/4, 0). 


. Absolute minimum value 1/2 at (1/2, 1/2). Absolute maximum value 5 at (2, 2). 

. Absolute minimum value — 93/18 at (1/6, 2/3). Absolute maximum value — 4 at (0, 0). 
_ Absolute minimum value — 1/27 at (1/3, 1/3). Absolute maximum yalue 7 at (152); 

. Absolute minimum value — 23/2 at (2, —3/2). Absolute maximum value 37 at (OA): 


Absolute minimum value — 3/2 at (27/3, 27/3). Absolute maximum value 3 at (0, 0). 


Absolute maximum value 1 at (0, 0), (0, 7), (7, 0) and (z, 7). Absolute minimum value —1/8 at 
(1/3, 1/3), (22/3, 27/3). 


F = f(x, y) + A@G, Y) => f,+Aod,=9 and fy + Ad, = 0. Eliminate A. 


=- 1/2, (, y) = (1, 1/2); maximum value is 1/2; minimum value is 0. 


A= 5/2. (x.y) = CVS, - 2/./5), minimum value is —./5: 


A= -V5/2, (x, y) = (V5, 2/V5), Maximum value is ¥5. 
Maximum value 3-¥3- 7)/3 at (V3/2, 7/3). Minimum value ~ (33 + 52)/3 at (- 3/2, 51/3). 


. Extreme value is V2. 


26. : The points (4, ma A); (- 4, 4) are farthest, d? = 32. The points (4/./3, 4/./3), (— 4/./3, _ 4/./3) are 





nearest, d* = 32/3. 
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. Rectangle must be a square. 

. Triangle must be an equilateral triangle. 

. The point is (AD/t, BD/t, CD/t), t=A*+ B+ C2. 
_ Extreme value is a°/27 at (a/3, a/3, a/3). 


31. Extreme value is (a + b+ c)° at (t/a, t/b, t/c), t=at bt+e. 

32. Extreme value is 3°7?"” at (¢, t, 1), t= 304. 

33. Extreme value is 24 at (2, 1, 1/2). 

34. Maximise V = 8xyz such that (x7/a”) + (y*/b?) + (z7/c*) = 1. We get (x, y, z) = (2alJ3, 2b/J3, 21 V3), 

35. Maximise xy’z° such that x + y + z=, a constant. We get x= a/6, y= 4/3, z= al2. 

36. Maximise 2(xy + xz + yz) such that 4(x + y + z) = a, a@ constant. We get x = y =z = a@/12, that is the 
parallelopiped is a cube. 

37. Maximise V = xyz such that xy + xz + yz = S/2, we getx=y=z= JS/6- 

38. Minimise S = xy + 2xz + 2yz such that xyz =a. We getx=y= (2a)'* and z = x/2. 

39. Maximise V = 2r7h/3 such that mrl = a where 1 = yr? +h? . We geth = V2r. 

40. Maximise V = 2r7H + (mr*h)/3 such that 2arH + mrl =S,1= Vr2 +h? . We get A/r = 2/+/5 and 
Hir = WAN5. 

41. Maximum value is 2/(3+/3) at (+ 2//3, + 2/./3, 1/3). 

42. Extreme value is 3/2 at (1/2, -1, 3/2). 43. Extreme value is 11/12 at (1/6, 1/3, 5/6). 

44. Farthest point (1, 0, 0), d = 1; nearest point (1/3, 0, 2/3) d= 5/3. 

45. The coordinates of the points P and Q are obtained as (2a/3, 2a/3, 2a/3) and (ta/V3, +a/V3, +a [3). 
Shortest distance : d* = a? (7 — 4.3)/3; Largest distance : d* = a2(7 + 4/3)/3. 

Exercise 2.5 


1. Curves intersect at x = +4/2 , y=2* 16/9/73. 


2. Curves intersect at (1, 1) and (4, —2); 9/2. 
4. Curves intersect at (0, 0) and (1, 1); 1/10. 


3. 8/3. 


9. Ri m4 < O< m/2, Asin OS r <4 sin 6; 3(1 + 24 


ones 
6. J= 
f--f ap f(x, y)dy dx + if I I(x, y)dy dx, where f (x, y= JI ee 2/2. 


: og 
Te f= 
¥ j. f(x, Yhdy aes | | I(x, y)dy dx, where f(x y)= aut 
> - x=4 y=x-—4 : x + i ~ 
20 In (5) — 18 In (6) + (7/2), 


x7 +y 





oa be eV dyde=(e-22. 9, [= i ate 
eee 
V2) 


10. me [ ue’ du dv = 5 (e- LY, Wl. 14/275. 


I 


n 


12. 
15. 


18. 


21. 


24. 
27. 
30. 


32. 


33. 


36. 
39. 
42. 
45. 
48. 
51. 
54. 





tJ 
- 2 
La 


Functions of Several Real Variables 


380/3. 13. x. 14. 817/16. 
128 a/15. 16. zi. 17. 2727/2. 
2a°/3. 19. (256 — 27m)/72. 20. 8(2- V2). 
Ta. 22. 208/3. 23. 27. 

a/90. 25. 4m} (4/2-1)/3. 26. 1/3. 

2m(1 — cos &)/3. 28. 1931/60. 29. 2na7/3. 
Lae nls =I. 31. M=3n2ka/32, T=¥ = 8ka’/(105 M). 
Evaluate the integral over 1 < x? + y? < q* and take the limit as a 3 ~. J = m/(p — 1). 
1/3. 34. 63/20. 35. 7/8. 
2mab/3. 37. (@° — &) m/16. 38. 1/96. 
a*/280. 40. 4/3. 41. 21. 

8/3. 43. 1/15. 44, 1/48. 

(8 In 2 — 5)/16. 46. 11/42. 47. 837/160. 
8/35. 49. 47 In (a/b). 50. 7/8. 
t-abcl4. 52. 7/10. 53. abc(a* + b*)/60. 
tha*/2. 55. 0. 


problems 56 to 60 compare the given integral with Eq. (2.107). 
a= BP=y=2,a=b=c=2,p=q=r=1,1=4/45. 
a=?) B=3, y=4,a=b=c=1,p=q-r- eer 


36. 
37. 
38. 
59. 
60. 





a= B=7=3/2,a=b=c=1,p=q=r=3,1= 6442 7/81. 
a= 2, B= 3/2, y=2,a=b=c=1p=1,9=3,r=4,1= 1/288. 


a=3,B=2,y=1,a=1,b=2,c=3,p=qar=2,1=78. 


Chapter ‘ 


Matrices and Eigenvalue Problem: 





3.1 Introduction 


In modern mathematics, matrix theory occupies an important place and has applications in almost al 
branches of engineering and physical sciences. Matrices of order m Xn form a vector space and they 
define linear transformations which map vector spaces consisting of vectors in IR” or C” into anothe: 
vector space consisting of vectors in IR” or C” under a given set of rules of vector addition anc 
scalar multiplication. A matrix does not denote a number and no value can be assi gned to it. The usua 
rules of arithmetic operations do not hold for matrices. The rules defining the operations on matrice: 
are usually called its algebra. In this chapter, we shall discuss the matrix al gebra and its use in solving 
linear system of algebraic equations Ax = b and solving the eigenvalue problem Ax = Ax. 


3.2 Matrices 


An m X n matrix is an arrangement of mn objects (not necessarily distinct) in m rows and n columns 
in the form 


oh D 412 “ee! (GER 
a2) 422 wee EO 

A=]| . (3.1) 
Am] Am? cae Amn 


We say that the matrix is of order m Xn (m by n). The objects aj), a)2,..., a», are called the elements 
of the matrix. Each element of the matrix can be a real ora complex number or a function of one or 
More variables or any other object. The element a, which is common to the ith row and the jth column 
is called its general element. The matrices are usually denoted by boldface uppercase letters A, B, C. 
-.. @tc. When the order of the matrix is understood, we can simply write A = (a;;). If all the elements 
Of a matrix are real, it is called a real matrix, whereas if one or more elements of a matrix are 
complex, it is called a complex matrix. We define the following particular types of matrices. 


Row vector A matrix of order | x 7, that is, it has one row and n columns is called a row 
4 Tow matrix of order n and is written as 


[aj;) 412 --> @m], or [a, a ... ay] 


vector or 
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in which a@,; (or a) is the jth element. 


| +8 Paes) at ix. 3 m rows and one column is Called a cy), 
Column vector A matrix of order m X 1, that 1s, it has umn 


vector or a column matrix of order m and is written as 


by 


b>, 
. fy OF 





Dm 
in which 6, (or 5;) is the jth element. 


The number of elements in a row/column vector is called its order. The vectors are usually denoteg 
by boldface lower case letters a. b.c,.. etc. If a vector has n elements and all its elements are reaq| 
numbers, then it is called an ordered n-tuple in IR", whereas if one or more elements are complex 
numbers, then it is called an ordered n-tuple in C”. 


Rectangular matrix <A matrix A of order m X n, m # n is called a rectangular matrix. 


Square matrices A matrix A of order m Xn in which m= n, that is number of rows is equal to the 
number of columns is called a square matrix of order n. The elements a;;, that is the elements a,,, 
@>>, - - . , @,, are called the diagonal elements and the line on which these elements lie is called 
the principal diagonal or the main diagonal of the matrix. The elements a;;, when t #7 are called the 


off-diagonal elements. The sum of the diagonal elements of a square matrix is called the trace of the 
matrix. 


Null matrix A matrix A of order m Xn in which all the elements are zero 1s called a null matrix or 
a zero matrix and is denoted by 0. 


Equal matrices Two matrices A = (2;;) mxn and B = (0; ))pxq are said to be equal, when 
(1) they are of the same order, that is m = p, n = q and 
(1i) their corresponding elements are equal, that is aj; = b; for all i, j. 

Diagonal matrix A square matrix A in which all the off- 


diagonal elements a;.. i+ ja is called 
3 | : jo | AJ are zero is calle 
a diagonal matrix. For example os 
ay) 0 
Ain ao 
= 's a diagonal matrix of order n. 
0 Ann 


A diagonal matrix is denoted by D. It is also written 


as diag lay) a eT ] 
If all the el ane : eu. : 
I the elements of a diagonal matrix of order n are equal, that is a;;= a for all i, then the matt! 


1S Called a scalar matrix of order n. 
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if all the elements of a diagonal matrix of order n are 1, then the matrix 


's Called an unit matrix or an identity matrix of order n. 





An identity matrix is denoted by I. 


Submatrix A matrix obtained by Omitting some rows and/or columns from a given matrix A is 
called a submatrix of A. As a convention, the given matrix A is also taken as a submatrix of A. 


3.2.1 Matrix Algebra 
The basic operations allowed on matrices are 
(i) multiplication of a matrix by a scalar, 
(ii) addition/subtraction of two matrices, 
(iii) multiplication of two matrices. 
Note that there is no concept of dividing a matrix by a matrix. Therefore, the operation A/B where A 
and B are matrices is not defined. 
Multiplication of a matrix by a scalar 
Let @ be a scalar (real or complex) and A = (a;;) be a given matrix of order m x n. Then 
B = aA = Q(a;) = (@a;) for all i and j. (3.2) 
The order of the new matrix B is same as that of the matrix A. 
Addition/subtraction of two matrices 


Let A = (a,;) and B =:(b,) be two matrices of the same order. Then 











C= (cj) =A+B= (jj) 45 (bj)) = (aj r bij), for all i and j (3.3a) 
and D = (d,;) =A- B = (a,j) — (6) = (ay — 5,), for all i and j. (3.3b) 
The order of the new matrix C or D is the same as that of the matrices A and B. Matrices of the same 
Order are said to be conformable for addition/subtraction. 


s A be... A, ate p matrices which are conformable for addition and Qi, &,..., O, are any 


C= aA, + %A,+...+@,A, (3.4) 


7 d linear combination of the matrices A;, A»,..., A,. The order of the matrix C is same as 





e matrix addition and scalar multiplication 
A, B, C be the matrices which are conformable for addition and @, 6 be scalars. Then 


on. oA. (commutative law) 


3 ee 
- Tr Tol du ws 
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(A +B) + C=A + (B+ ©) (associative law). 


t 


3. A +0=A (0 is the null matrix of the same order as A). 


4. A+(—A)=0. 5. a(A + B) = @A + GB. 
6. (a+ BP)A= aA + BA. 7. Q( BA) = aPA. 
S IXA=A and OxA=-0O. 


Multiplication of two matrices 


~ ) sr of CO ns in A JS equa 
The product AB of two matrices A and B is defined only when the number of oe “— ‘e ’ : 
to the number of rows in B. Such matrices are said to be conformable for mul ti plication. Let A = (a,) 
be an m X n matrix and B = (6; be ann X p matrix. Then the product matrix 





12 ? 1p 
b 55 b 2p 
= (C;; ) = — 
Bn? np 
mXn it X p 


is a matrix of order m x p. The general element of the product matrix C is given by 


C= aj); We aj2b3; tt aes =P Ain Dn; = 2, ip dy;. (3.5) 
In the product AB, B is said to be pre-multiplied by A or A is said to be post-multiplied by B. 


If A is a row matrix of order 1 x n and B is a column matrix of order n X 1, then AB is a matrix 
of order | x 1, that is a single element, and BA is a matrix of order n x n. 


Remark 1 


(a) It is possible that for two given matrices A and B, the Product matrix 
product matrix BA may not be defined. For example, if A is a 2 
matrix, then the product matrix AB is defined and is 
product matrix BA is not defined. 


AB is defined but the 
x 3 matrix and B is a 3 x4 
a4 matrix of order 2 x 4, whereas the 


| a th the matrices AB and BA are 
square matrices. In general AB * BA, Thus, the matrix product is not commutative. If AB = 


BA, then the matrices A and B are Said to commute with each other. 


(c) If AB=0 that either A = 0 or B = 0. For example, let 


x OF 
y 0 a b 


oO" Pe= 9% : 
AB = and BA = 0 
6 xp fee by o|*AB 





it does not always imp] 
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(d) If AB = AC, it does not always 


imply that B = C. 
(e) Define A*=AXA. 


ia <aid to be bil shone (K times). Then, a matrix A such that A‘ = 0 for some positive integer 
k is sald to be Yilpotent. The smallest value of k for which A* = 0 is called the index of 
nilpotency of the matrix A. 


i If A” = A, then A is called an idempotent matrix. 
properties of matrix multiplication 


1. If A, B, C are matrices of orders m x n,n X p and p X q respectively, then 


(AB)C = A(BC) (associative law) 
is a matrix of order m x qd. 


2. If A is a matrix of order m x n and B, C are matrices of order n x p, then 
A(B+C)=AB+AC (left distributive law). 
3. If A, B are matrices of order m x n and C is a matrix of order n x p, then 
(A+ B)C=AC+BC (right distributive law). 
4. If A is a matrix of order m x n and B is a matrix of order n x p, then 
a(AB) = A(@B) = (@A)B 


for any scalar @. 


3.2.2 Some Special Matrices 
We now define some special matrices. 


Transpose of a matrix The matrix obtained by interchanging the corresponding rows and columns 
of a given matrix A is called the transpose matrix of A and is denoted by A’, that is, if 


@i1 @12 a2} ee ete 
a> 292 a2 m2 

A= ; 
Am2 42n Amn 





By 







ATA =(n X m)(m X n) is an n Xn square matrix 


-_ 


AA? = (m X n)(n X m) is an m X m square matrix. 





cae A. 

ae es | T 
nn vector b can also be written as iby Os Bp) 
g results can be easily verified 


i) rr. 
OWN 
ee 


ei, 


ine Mathematics ey 
1.6 Engineering Ma ‘cormable for addition. 
| " mable 
r— aT 4B’, when the matrices A and Bare cantor f [tiplication 
. BY = A‘ + B’, whe | $n Ene tah tion. 
etn raT when the matrices A and B are conformable fo 
| i oe BA‘, when the mé : 
4. (AB) = 
‘< defined, then 
If the product Aj Ap . - - A, is defined 


rT T ay se 
PA As acy eg pet 


ane ) of order 1 Xn and a column vector b; = (b); by, 


= Peau ; a; and b,, that is 
The product of a row vector a; = (aj, 42 - in ectors a; and S 


or the i duct of the v 
| oduct or the inner pro 
b,j). of order n X 1 is called the dot produ 
cj = a,°b;= P» Ai OK; 


in Eq. (3.5) can be written as 
which is a scalar. In terms of the inner products, the product matrix C in Eq ( 


a,b, a,: D2 f atie.« a,: Dp 

a:b, ay: b> =e az-b, , (3.6) 
Ceans ' = & 2 #8 

an b, @n,:bz «.-. Dy» by 


Symmetric and skew-symmetric matrices A real square matrix 2 = (aj;) is said to be 
symmetric, if aj; =a, for all i andj, that is A= A 
skew-symmetric, if ay =— aj for all i and j, that is A =— AT 
Remark 3 
(a) In a skew-symmetric matrix A = (a 


(b) The matrix which is both symmetri 





ij), all its diagonal elements are zero. 


c and skew-symmetric must be a null matrix. 
(c) For any real Square matrix A, the matrix A +A’ is always Symmetric and the matrix A — A’ 
is always skew-symmetric, Therefore, a real 


} square matrix A can be written as the sum of a 
Symmetric matrix and a Skew-symmetric matrix. That is 


A=z(A+A 41 (4 =iAT), 
Triangular matrices A square matrix A = (q 
whenever i < j, that is all elements above t 

matrix if a = 0, whenever js J, that is all 


Conjugate matrix Let A = (a;;) bea complex matrix. Let ai; denote the 
Then, the matrix A = (4;;) is called the conjugate matrix ma 
Hermitian and skew-Hermitian matrice 
A=A! or A=(A)? and a ske 
Hermitian matrix is denoted by A” 
Remark 4 


(a) If A is_a real matrix, t 
Hermitian matrix is sa 


i) is Called a lower triangular matrix if a; = 0, 
he principal diagonal are zero and an upper triangular 
the elements below the Principal diagonal are zero. 


complex conjugate of ay 


mix A is called an Hermitian matrix it 


or A*, =—ATor A = —(A)7. Sometimes, 4 


hen an Hermitian Matrix is sq 
me as a 


me asas Mmetrj kew- 
Skew-symmetri eanates y {ric matrix and a s 
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(b) In an Hermitian matrix, all the diagonal elements are real (letaj;=x,+iy,;; then aj = ay gives 
Apt typ = Xj—lyj OF y; = 0 for all j). 


(c) In a skew-Hermitian matrix, all th 


€ diagonal elements are either 0 or pure imaginary 
Met ay = x + by; 


3 then ajj = —ajy gives xj + Ly; = — (x; —ty,;) or x; = 0 for all /). 
(Jd) For any complex square matrix A, the matrix A + A is always an Hermitian matrix and the 


. —T, | 
matrix A — A is always a skew-Hermitian matrix. Therefore, a complex square matrix A can 


be written as the sum of an Hermitian matrix and a skew-Hermitian matrix, that is 


A=3(A+ A’) +2 (A - A’). 
Example 3.1 Let A and B be two Symmetric matrices of the same order. Show that the matrix AB 
is symmetric if and only if AB = BA, that is the matrices A and B commute. 
Solution Since the matrices A and B are symmetric, we have 

A’=A and B’=B. 
Let AB be symmetric. Then 
(AB)’=AB, or B’A’=AB, or BA=AB. 

Now, let AB = BA. Taking transpose on both sides, we get 

(AB)' = (BA)! = A’ B’ = AB. 


Hence, the result. 


3.2.3. Determinants 


With every square matrix A of order n, we associate a determinant of order n which is denoted by 
det (A) or | A |. The determinant has a value and this value is real if the matrix A is real and may be 
real or complex, if the matrix is complex. A determinant of order n is defined as 


ay| a}2 or Qin 


G21 22s a, , 
det (A) = | A | melt ae : (3.7) 
| 2 | a n2 “n8 3 Ann 








Pikes discuss methods to find the value of a determinant. A determinant of order 2 has two rows 
and two columns. Its value is given by 
a} 12 





= 411422 — @)2a2). 


[A |= 








a2\ 422 
nf x j : 3 . 

We « Waluate higher order determinants using minors and cofactors. 

: Pees tisctors Let aj; be the general element of a determinant. If we delete the ith row and 
= from the determinant, we obtain a new determinant of order (n — 1) which is called the 
ats Aft a;,. We denote this minor by M;;. The cofactor of the element a,; is defined as 
ANA el) Ka ie 


Ay = (- 17 My (3.8) 


—e fs determinant of order n through the elements of any row or any column. The value 


oe Lee 
ah bo ce 
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, F the i v (or jth column) and the; 
of the determinant is the sum of the products of the elements of the ith row (or J : 
corresponding cofactors. Thus, we have 


nN 
+) = 2 ajyAj (3.9; 

|Al= x (-1)'4 ayy Mij = 24 aijAy a 
j= 


when we expand through the elements of the ith row, or 


5 It] oe Mis = a; ;Aijj (3.9b) 

: : rminant throu: 
when we expand through the elements of the jth column. Generally, we ex ae a Se Auaiahe sees 
that row or column which has a number of zeros. We can use one or more of the g properti 
of the determinants to simplify the evaluation of determinants. 


Properties of determinants 
1. tf all the elements of a row (or column) are zero, then the value of the determinant is zero. 


2. The value of a determinant remains unchanged if its corresponding rows and columns are 
interchanged, that is 


|A|=|A"]. 


3. If any two rows (or columns) are interchanged, then the value of the determinant is multiplied 
by (— 1). 


4. If the corresponding elements of two rows (or columns) are same, that is two rows (or 
columns) are identical, then the value of the determinant is zero. 


5. If the corresponding elements of two rows (or columns) are proportional to each other, then 
the value of the determinant is zero. 


6. The value of the determinant of a diagonal 


or a lower triangular or an upper triangular matrix 
is the product of its diagonal elements. 


7. If each element of a row (or column) is multiplied by a scalar a, then the value of the 
determinant is multiplied by the scalar @. Therefore, if Bis a factor of each element of a row 
(or column), then this factor B can be taken out of the determinant. 


Note that when we multiply a matrix by a 


ree scalar @, then every element of the matrix is 
multiplied by a. Therefore, | 7A |= aq" | A | 


Where A is a matrix of order n. 
8. If each element of any row (or column) can be 


| written as the sum of two (or more) terms, then 
the determinant can be written as sum of two 


(or more) determinants. 

2. ifa non-zero constant multiple of the elements of some row (or column) is added to the 
corresponding elements of some other row (or column), then the value of the determinant 
remains unchanged. 


Remark 5 

When ae peene of ee foW are multiplied by a non-zero constant k and added to the 
corresponding elements of the ith row, we denote this operatic 7 SEER, where R; is 
the ith row of | A |. The elements of the ieee * Bh: where R, 


Jth row remain unchanged whereas the elements of the 
ith row get changed. This operation ; | | 
ith row get changed. Thi Operation is called an elementary row operation. Similarly, the 
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operation C; <— C; + kCj, where C, is the ith column of | A |, is called the elementary column 


operation. Therefore, under elementary row (or column) operations, the value of a determinant 
is unchanged. 


40. The sum of the products of elements of any row (or column) with their corresponding cofactors 
gives the value of the determinant. However, the sum of the products of the elements of any 
row (or column) with the corresponding cofactors of any other row (or column) 1s Zero. Thus, 


we have 
A | A I i =J : 
~ Dip Ajg= (expansion through ith row) (3.10a) 
0 i#j 
or y ay: Ay; = ae 3 ion through jth column) (3.10b) 
ga THEE | (expansion through jth c ; J. 





11. |A+B |+|A|+]|B|, in general. 


Product of two determinants 
If A and B are two square matrices of the same order, then 
| AB|=|A || B]. 
Since | A | =| A’ |, we can multiply two determinants in any one of the following ways 
(i) row by row, (ii) column by column, 
(iii) row by column, (iv) column by row. 


The value of the determinant is same in each case. 


Rank of a matrix 


zero minor of | 
Therefore, the rank of a matrix is the largest value of r, for which there exists at least one r X r 
submatrix of A whose determinant is not zero. Thus, for an m X n matrix r < min (m, n). For a square 
Matrix A of order n, the rank r =n if | A | #0, otherwise r<n. The rank of a null matrix is zero and 
if the rank of a matrix is 0, then it must be a null matrix. 


The rank of a matrix A, denoted by r or r(A) is the order of the largest non- 











Example 3.2 Find the value of the determinant 


He et ah 
23. 9 


" (i) us ng elementary row operations, (i1) using elementary column operations. 


@A yplying the operations Ry < Ro — (3/2)R; and R; — Rs + (1/2)R), we obtain 
| i ae 
|A|=|0 w2 11/72 
Be 9726 3/2) 
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Applying the operation R3 <— R3 — 7R, we obtain 


2 1 -l, 
}AJ=/O 1/2 11/2] = 2(1/2)-37) = -37 
On  O pa G7 


since the value of the determinant of an upper triangular matrix is the product of diagonal elements. 


(ii) Applying the operations C, < C, — (1/2)C, and C3 < C; + (1/2)C), we obtain 


ow 0 0 
[AlS| 3 1 t12 
en ele. 


Applying the operation C; < C, -— 11C), we obtain 


2 6 0 
‘Al=) 3 ie 0 | = 2(1/2)(—37) = —37 
= 712) 37 


since the value of the determinant of a lower triangular matrix is the product of diagonal elements. 


Example 3.3. Show that 


] 1 ] 
JAl=|a@ By |=(a-B\B-yy\y- a). 
a2 B? y? 
Solution Applying the operations C, C, — C3 and Co <— C= C3, we get 
| 0 0 ] 0 0 ] 
|A|=|a-y Boy Y |=(@-y)B-y)}| 1 l Y 


Dewiyle | A220 2 
a ee ey a a ee 


] 
a+ y Bt+y =(@— y(B-y)\(B+ y— a - 7) 
=(a-y)(B-y)(B- a) = (a- B)(B-y)(y- a), 


Example 3.4 Given the matrices 


=(a@-y)(B-y) 








3 9 
A=/|4 5 6), B=/] =—s 9 
(jm See? l i 
verify that | AB [=|A|| BI. 
Solution We have 
hel 2 Sie Pee 5 8 13 8 
Bee 5. 6 Pg | hye 25 20 
te =—B Oly © Ie] 


22 117 Q 
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AB | = )« 
therefore, |AB/=/23 25 29] = gy _ 2340) — 23(0 — 936) + 22(260 — 200) 
84 a ais 





= — 18720 + 21528 + 1320 = 4198 
We can find the value of the product |A|| BI directly as 


ie ney. 1) [ae =a — as i 
Sahil =5 3 = 28 9 45 (multiplying determinants 
=—$§ 9/)/1 ji 14 65 =A0 row by row) 


= 10(360 — 2925) — 28(120 — 1170) + 14(— 135 + 162) 
= — 25650 + 29400 + 378 = 4128. 
We can also find | A | and | B | and then multiply. 
Example 3.5 Without evaluating the determinant, show that 
cos(A-—P) cos(A—@Q) cos(A-R)| 
D=|'cos(B—P)  cos(B=Q)  cos(B=—R)|=0. 
cos(C-—P) cos(C-—Q) cos(C-R)}] 


Solution Expanding all the terms, we have 


cosAcosP+sinAsinP cosAcosQ+sinAsinQ cosAcosR+sinAsinR | 
D=\|cosBcosP+sinBsinP cosBcosQ+sinBsinQ cosBcosR+sinBsinR 
‘cosCcosP+sinCsinP cosCcosQ+sinCsinQ cosCcosR+sinCsinR 


cosA  sinA 0O|]|cosP sinP O 
=|lcosB sinB O||cosQ sinQ 0/=0x0=0. 
cosC sinC Oj} | cos R sink 0 










on Since the matrix A is of order 4, r (A) < 4. Now, r (A) = 3, if | A | = 0 and there is at least 


a na Si ee: of order 3 whose determinant is not zero. Expanding the determinant through the 





4 
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0) 0) 
() Li Lj me ula — 6) + Ll] -6 
( 


rc 0] 
[Ale al 0 Li lL} 4 
| ) G | 


: 


Setting | A | = 0, we obtain v= 1, 2, 3, For fis 1, 2, 3, the determinant of the leading third orde, 
submatrix 


= Ml - Ou" t+ llu—-6 = (d= 1) = 2)(M — 3). 


Mo | 0 
lArJ=/0 aw -ll=u°¢0. 
PM eS Te 


Hence r(A) = 3, when f= | or 2 or 3. For other values of li, r (A) = 4. 


3.2.4 Inverse of a Square Matrix 

Let A = (a, be a square matrix of order n. T hen, A is called a 
(1) singular matrix if | A | = 0, 
(ii) non-singular matrix if | A | # 0. 


In other words, a square matrix of order n is singular if its rank 
r (A) =n. A square non-singular matrix A of 
singular square matrix B of order n such that 


AB = BA =I 


where I is an identity matrix of order n. The matrix B is ca 
B= A™ or A= B™. Hence, we say that Aq! 


(A) <n and non-singular if its rank 
order n is said to be invertible, if there exists a non- 


(3.11) 


lled the inverse matrix of A and we write 
is the inversé of the matrix A, if 


AA = AA"! = 1p 


(3.12) 
The inverse A~' of the matrix A is given by 






(3.13) 
where adj(A) = adjoint matrix of A 


= transpose of the matrix of cofactors of A. 
Remark 6 


(a) (AB)" = B1A-!, 
This result can be easily proved. We have 


(AB)(AB)"! = |. 


Premultiplying both sides first by A~! and then by B™ we obtain 
B~'A™' (AB)(AB)"! = B™(A™'A)B(AB)"! = BI A- or (AB)! = B-4-! 
In gene Wi lve : “+= Ang!a- 2 

In general, we have (A, A>... A,)'= A> Beer - Bia: 
by If A and B are non-singular matrices, then AB is also a non-singular matrix. 
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(c) 1 if AB=O0andA isa non-singular matrix, then B must be a null matrix, since AB = 0 can be 


= 
‘premultiplied AE ie a non-singular matrix, then A must be a null matrix, since 
AB = 0 can be post multiplied by B-. 





(d) It If AB = AC and A is a non-singular matrix, then B = C (see Remark 1(d)). 
(e) (A + B)'#A'+B" in general. 


——<—<L— LLU 
properties of inverse matrices 


1. If A” exists, then it is unique, 


ee =A 
meee = (A~)’,.( From (AA>')7 = 1 = 1, we get (A“')’A’ =I. Hence, the result). 
. Let D = diag (d), dy,,... , d,,), d;, #0. Then D™! = diag (1/d,,, I/dy, .. . , Wdyn). 


5< The inverse of a Gino. upper_or lower triangular matrix is a an upper or a 
lower triangular matrix. 


| 


6 The i inverse of a non-singular s symmetric matrix is a symmetric matrix. 


a a (a7 )" = A” for any positive integer n. 


——— 
— a 


2 
Example 3.7 Show that the matrix A=|5 1 0 | satisfies the matrix equation A° — 6A* + 
Pn 


HNA-I=0 Where I is an identity matrix of order 3. Hence, find the matrix (i) A”! and (ii) A-. 
Solution We have 










: Oo -l Jai) 
Aa |5 15 =a 
] 5 4 9 
. el -1 3 -6 -19 
are ) 15 1] O;=|35 -4 -30 
A “ae ile? 3\ so ia oD 
7 g in B= A’ - 6A? + LIA -I, we get 
= _ 
24 -6 -30| 0 -11 lo © 
30 | — | 90 6 -30/+|55 11 O;-|0 1 =O 
Parag 24 54 itt 33 Or 0" "1 
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| = rh, we gel 
(i) Premultiplying A? - 6A* + LIA-I=0 by A g 
A143 6A7A2 + LIATA-A™ =0 


or A=A*-—6A+ 111 
ap 5 ie 6 =o) (ih oO 3 ! 
sigs oy =slel30 6 Ol+| 0 11 Ole) —1o 6 
; 3, 
5 a 9 foe 19) Oo © 11 5 2 
Bh ad | =i | 0 nn 10 
Gi) A-*=(A™)? =|-15 6 ~—5 5° =§'|= |=160 Gin 55) 
5 -2 2 — 4, 2 35 = 2] 19 





3.2.5 Solution of n x n Linear System of Equations 


Consider the system of n equations in n unknowns 
41, X%, + Qjz%_2 +... + Ayy,X, = b, 


49, X1 + 0x2 XZ +... + Gz, X, = bo 


See Ree eee ee er hl 





Qty + GpoXo +... a,x, = D,. 


In matrix form, we can write the system of equations (3.14) as 


Ax=b 
Sy Gig ake} @}, b, 41 1 
where A= e ee a b= 72  xa|* 
| Any an? mete Ann b,, ee. iN 


and A, b, x are respectively called the coefficient matrix, the right hand 
solution vector. If b # 0, that is, at least one of the elements b,, b> 
of equations is called non-homogeneous. If b = 0, then the syst , 
System of equations is called consistent if it has at | 
solution. 


Non-homogeneous system of equations 
The non-homogeneous system of equations Ax = 
Matrix method 


Let A be non-singular. Premultiniy; a = 
on-singular remultiplying Ax=b by AW we Slee. 


Xx=A7'b. 


b can be solved by the following methods. 


Side column vector and th 
-..,, is not zero, then the syster 
em of equations is called homogeneous. Th 
Cast One solution and inconsistent if it has n' 


(3.16) 
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The system of equations is consistent and has a unique solution. If b = 0, then x = 0 (trivial solution) 
is the only solution. 


Cramer's rule 
tet A be non-singular. The Cramer's rule for the solution of Ax = b is given by 
_ [Ai] 
eon eee 3.17) 
— TAT ea) a" ee ( ) 


where | A;| is the determinant of the matrix A; obtained by replacing the ith column of A by the right 
hand side column vector b. 


We discuss the following cases. 


Case 1 When | A | + 0, the System of equations is consistent and the unique solution is obtained by 
using Eq. (3.17). 


Case 2 When | A | = 0 and one or more of | A; |, i= 1,2,...,m are not zero, then the system of 
equations has no solution, that is the system is inconsistent. 


Case 3. When | A | = 0 and all | A;| = 0, i= 1, 2,...,n,.then the system of equations is consistent 
and has infinite number of solutions. The system of equations has at least a one-parameter family of 
solutions. 

Homogeneous system of equations 

Consider the homogeneous system of equations 

Trivial solution x = 0 is always a solution of this system. 


If A is soe stnenlar, then again x = A_'0 = 0 is the solution. 





= 
A WwW = | Tt «all a. eet 
i - : 
a SF. 


— rations s has infinite number of s solutions. 
- -.. 3 ‘ 


= 


Exa Exampl le 3.8 Show that the system of equations 
ye 1 l 









1 


~3}=1(1+3)-2-1-1+13-1=10+0. 





singular and the given system of equations has a unique 
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(1) We obtain 


4 2 2 4 
At=t)_5 0 5) and b=/0 
I 
lis = 24" 3 2 
4 2 214 2 | 
Therefore, x=A'b= a ='§ Hj » Sko = | —] 
1 =f 32 It 


Hence, x = 2, y=— 1 and z= 1. 
(ii) We-have 








i es | I 
|A,|=]0 1 -—3)=4(1 + 3) -0+2@G —- 1) =20° 
2 it l 
4 I 
[A,/=|/2 O -3]=1(0+ 6) —2(4 -2)+ 1-12 —0)=-10- 
2 l 
il esjh 
| A3|=|2 I 0O}= 12-0) -2(-2 —4)+ 100 -4)= 10. 
l LE 2 
. | Ai| | A> | | A; | 
Therefore, ais =e a = oF ok eu Bee 
ae a r= ae bapa 
Example 3.9 Show that the system of equations 
] —] 3 Xy 3 
2 3 ] X94 2 
3 eZ 4 x3 5 


has infinite number of solutions. Hence, find the solutions 


Solutions We find that 


Pyeng 3 19) 
A 8 Pde Weel ei, a 4 = 0, 
ime. 2 4 5 4 

ann3 bi 1 
ij SEH OF WAG On oo leng 
3 4 3 5 
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nerefore, the system of 4c al Bitar 
Th y equations has infinite number of solutions. Using the first two equations 
%1-xX,=3- 3X3 
2x; + 3X5 = 2— x; 
and solving, we obtain xX; =(1] - 10 x4)/5 and x 
Pg 


satisfies the third equation. = (5x; — 4)/5 where x; is arbitrary. This solution 


Example 3.10 Show that the System of equations 





4 9 31x 6 | 
2 3 Iiyl=|2 
2 6 2iHez is 
is inconsistent. | 
Solution We find that 
4 3 6 3 
(Ae 2) 3F TSO TA |2 "3 lao, 
2 2 7 2 
de Whee 3) 
AE? 2 leg. 
7 ey ee 


Since | A | = 0 and | A; | # 0, the system of equations is inconsistent. 
Example 3.11 Solve the homogeneous system of equations 
leiligt 2 ale lmao 
2 SF SBiy l= On. 


rae Be No 


Solution We find that | A | = 0. Hence, the given system has infinite number of solutions. Solving 
the first two equations 


| PET Sie 


"we obtain x = 13z y = — 8z where z is arbitrary. This solution satisfies the third equation. 
MM UULGITL A = LId, ) ) 










oa a eee | 
_ : Sls ail at ee 
B|=| A||B |, (ii) |A+B|# | A|+|B|. 
ipl 5, 7), B= (3: 1s 2) verify that (AB)" = BYA’, 





ny 


-“ 
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or Fue 
3. Show that the matrix A=|2 1 2] satisfies the matrix equation A* — 4A — 5I = 0. Hence. 
7 7 | 
find Av’. ia 
l ] 
4. Show that the matrix A =| 1 2  —3] satisfies the matrix equation A? — 6A* + 5A + III = 0, 
2 -!l 
Hence, find A“. 
| 0 1 -1 
5. Forthe matrix A=|4 -—-3 4 |, verify that 
I —3 4 
(i) [adj (A)]" = adj (A"), (ii) [adj (A)J"' = adj (A). 
me =—2e J 
6. For the matrix A =| —2 3 114, verify that 
] I, 46 
G@) (A= (Atyt, (ii) (AT) =A. 
2 -!l I ro 2 i 
7. For the matrices A = | —] 2 -1|,B=|1 3 = 4/, verify that 
1 -l 2 2 iO 9 
(i) adj (AB) = adj (A) adj (B), (ii) (A+B)'# A! +B 


10. 


11 


iL] 


12. 
13. 
14, 


15. 
16. 


an 





. For any non-singular matrix A = (a) of order n, show that 


(i) | adj (A) |=| A |", (ii) adj (adj (A)) =| A |""7A. 


- For any non-singular matrix A, show that | A | = 1/| A |. 


For any symmetric matrix A, show that BAB’ is symmetric, where B | i icht 
. re me e B is any matrix , | oduc 
matrix BAB’ is defined. i y for which the product 


If A is a symmetric matrix, prove that (BA~!)7(A~B1)-! = T w a | a | 
matrices are defined. ( y( ) =I where B is any matrix for which the product 


If A and B are symmetric matrices, then prove that 
(i) A + B is symmetric, (ii) AA’ and ATA are both symmetric 
(ili) AB — BA is skew-symmetric. 


If A and B are non-singular, commutative and symmetric matrices then prove 


(i) AB, (ii) AB, (iii) A~ Bo! 
are symmetric. 


that 


Let A be a non-singular matrix. Show that 

Gi) if 1+A+A*+...+A"=0, then A-! = A” 
(ii) if1-A+A?-...+(-1)"A"= 0, then A-! = (— jy"-lqn 
Let P, Q and A be non-singular square matrices of order 
If 1— A is a non-singular matrix, then show that 


ae. Vey eo ee) a 
assuming that the series on the right hand side converges. 


n and PAQ = I, then show that A~! = QP. 
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17. For any three non-singular matrices A, B. C, each of order n, show that (ABC)! = CB! A“!, 
pstablish the following identities: | 














| ] w Ww | 
Es 2 | 
18. |’ rf 1 | =0, where w is a cube root of unity. 
we 1 W 
I be Bib 
- _ —a 
19. is = 0. 20. |b-c c-a a-b!l=0. 
a Cc-a a-b b-e 
be a* a? be ab ac =a ab ac 
ee el =\ab ac bel 2 | gb 2 be | =4a2h2c2. 
ren ie? ab ac be ab ac be Co 
| (b + c)? a? a’ 
oa (a+c)? b> | =2abe(at b+c)3. 
c? c? (a+b)? 
a b Cc 
24. | a? b? c* |=(a-b)(b- c)\(c-—a)\(a+b+c). 
b+e cta a+b 
12 
| Z 
%.\y z x| =(x3+y24+23-3xyz)?. 
fae OY 
1 1 1 
Y 8, | =(@- B@- y)(a- 5\(B- y (B= d)(y- 6). 
y3 53 | 


(a+q@) sin(b+ a) sin(c + @) pan | 
| sin (a + i ) sin(b+P)  sin(e+ B)}=0 foralla,b,c, a, Bandy. 
|s sin (a+y 4 : sin (b+ Y) sin(c + ¥) | 














A. a 

ing ng system of equations: 

y+z=2, 2x a) - -z= ak ye z= 0. 

3x -ytz=3,—xt By t4z=6. 


25 which the system of equations 
ue ; ™ a is = 

.— ky +20, ke +3y-kz=0, 3x+y-z=0 
: (ii) ne on-trivial so | solution. 


See LIRIMCeTING (VECO MICIEC 


33. Find the value of @ for which the system of equations 
2(sin 0)x+y—2z2=0, 3x + 2(cos 20)y+3z2=0, Sx +3y—-z= 
has a non-trivial solution. 
| = = 0, where a, b, ¢ are non-z, 
34. If the system of equations x + ay + az = 0, bx+y+b6z=0,cx+cy +z 0 ero 
and non-unity, has a non-trivial solution, then show that 





ad b eerie! mapa. Ts 
laa Teh lc 


35. Find the values of A and y for which the system of equations 
x+2y+z=6, x+4y + 3z = 10, x+4y+Az=yu 
has a (i) unique solution, (ii) infinite number of solutions, (iii) no solution. 


Find the rank of the matrix A, where A is given by 


l 3 -4 
36. ; ; MI ai 23 4 i. 
s 5 4 a eae 
eee “al ee 
38. 2 eeatl 39. Pp r 
f= 3 ys 
sai ss a ae Tie 
ee) ees | | tam 
40 3) bee Qe Se 4), (b) a oa Na. (b, ce. + 0,7 = 1,2. 
Ce Oy ee a 
-a, -b, -c, 0 


41. Prove that if A is an Hermitian matrix, then 7A is a skew-Hermitian matrix and if A is a skew-Hermitian 
matrix, then iA is an Hermitian matrix. 
42. Prove that if A is a real matrix and A" 0 as n > ~, then I+ A is invertible. 
43. Let A, B ben xn real matrices. Then, show that 


(1) Trace (@A + BB) = @ Trace (A) + B Trace (B) for any scalars @ and B 


(ii) Trace (AB) = Trace (BA), (iii) AB-BA =Tigs never true, 
44. If B, C are nxn matrices, A=B+C BC = CB and C?=9 
; ; 3 =U, th ) +h 
for any positive integer p. Sent ar pee ate + NC) 


45. Let A = (a;;) be a square matrix of order n, such that q 
| A | =(c-d)""[o + (n - 1)d], 


Identify the following matrices as symmetric, skew 


y=4,i# janda,=c, j=; Then show that 


~Symmetric, Hermitian, skew-Hermitian or none of these: 


] eo 3 Ta hb e 
es). 5. 41 PTA Biel ax ell 
4. ¢ a ee 
Go + 
48. ‘ . | 2+4i ]-j 
Se TP eos) S| a 5; | 
-c -e 





 l+i 3+ 5] 6 
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l 2+4; hei 
50. —2+4i =5 3-5i |, 
pal hea, 3 = Si 6 


0 24+ 4i 3 
Sl. |-2+4; 0 ere 
—-l|-j —-3-S5i 0 


: pee 
: ae 0 —| 1+; 
3 “ak 
oe |! Soa ot oe oy 8G 
I l 0 . 
—l4+i 0 i 
: - bk 2 =i 
ewe tai SS?) i at) 
—-i I1+i 9) : ; 


3.3. Vector Spaces 


Let V be a non-empty set of certain objects, which may be vectors, matrices, functions or some other 
objects. Each object is an element of V and is called a vector. The elements of V are denoted by a, b, 
¢, u, V, etc. Assume that the two algebraic operations 


(1) vector addition and (ii) scalar multiplication 
are defined on elements of V. 
If the vector addition is defined as the usual addition of vectors, then 
a b= (Gj, ao, .. « , &,) + (Dj, Do, ... , By) = (ay + Oy, ap + bo,.: «. , a, + B,). 
If the scalar multiplication is defined as the usual scalar multiplication of a vector by the scaler a, then 
OR= Ody, Ops s1000,14,) = (Bay, Ban... . , ‘Aa,). 
The set V defines a vector space if for any elements a, b, ¢ in V and any scalars a, 6 the following 
properties (axioms) are satisfied. 


Properties (axioms) with respect to vector addition 


l. a+b is in V. 
2.a+b=bea. (commutative law) 


3. (a+b) +c=a+ (b+). (associative law) 
(existence of a unique zero element in V) 


4.a+0=0+a=a. 


(existence of additive inverse or negative vector in V) 


(right distributive law) 
(existence of multiplicative inverse) 
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ed the closure properties. When these two properties are 
losed under the vector addition and scalar multiplication, 
defined above need not always be the usual addition ang 
ds not only on the set V of vectors, but also on 


The properties defined in 1 and 6 are call 
satisfied, we say that the vector space 1s c 
The vector addition and scalar multiplication 
multiplication operators. Thus, the vector space depen : ; 
the definition of vector addition and scalar multiplication on V. 

If the elements of Varereal, thenit is called a real vector space when the ama : oe puters, 
whereas V is called a complex vector space, if the elements of V oe complex fast ee a * 2 
be real or complex numbers or if the elements of V are real and the scalars @,, | omplex numbers 


Remark 7 

(a) If even one of the above properties is not satisfied, then V is not a vector space. We usually check 
the closure properties first before checking the other properties. 

(b) The concepts of length, dot product, vector product etc. are not part of the properties to be satisfied. 

(c) The set of real numbers and complex numbers are called fields of scalars. We shall consider vector 

spaces only on the fields of scalars. In an advanced course on linear algebra, vector spaces over 
arbitrary fields are considered. 

(d) The vector space V = {0} is called a trivial vector space. 


The following are some examples of vector spaces under the usual operations of vector addition and 
scalar multiplication. 


1. The set V of real or complex numbers. 


2. The set of real valued continuous functions f on any closed interval [a, b]. The 0 vector 
defined in property 4 is the zero function. 


3. The set of polynomials P, of degree less than or equal to n. 
4. The set V of n-tuples in IR” or C". 


- The set V of all m Xn matrices. The element 0 defined in property 4 is the null matrix of order 
mx HR. 


The following are some examples which are not ve 


< ae. ctor spaces. Assume that usual operations of vector 
addition and scalar multiplication are being used. 


1. The set V of all polynomials of degree n. Let P, and Q, be two polynomials of degree n in V. 
Then, aP,+ BQ, need not bea polynomial of degree n and th us May not be in V For example 
if Ph=x"+a,x""'+...4a, and Oye ax" + bie 42 bth Me° amp! : 
of degree (n — 1), “++ On, then P,, + Q, is a polynomia 

2. The set V of all real-valued functions of one variable x, defined and continuous on the closed 
interval la, b) such that the value of the function at b is some non-zero constant p. For 
example, let f (x) and g(x) be two elements in V. Now, f(b) = 2(b) = p. Si b) + 2(b) = 2p: 
J (x) + g(x) is not in V. Note that if p =0, then V forms a ne 5 ao. 

es vl ae ae the of all polynomials, with real coefficients, of degree n, where addition 
detined by a a) and under usual scalar multiplication. Show that V is not a vector space. 


Solution Let P,, and Q,, be two elements in V. Now, } 


7 
# 


2n, which is not in V. Therefore, V does not et. ita r: Tee is a polynomial of degree 
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pxample 3.13 Let V be the set of all ordered pairs (x 
Let a= (x, ¥1) and b = (x5, 


y), where x, y are real numbers. 


y2) be two elements in V. Define the addition as 


A D= (4,99) + Gro, Ya) = (2x1 — 3x2, y; — y2) 


and the scalar multiplication as 

A(x, 1) = (@x,/3, ay, /3). 
Show that V Is not a vector space. Which of the properties are not satisfied? 
Solution We illustrate the Properties that are not satisfied. 


(i) a Ya) + 1, V1) = (2x - 3x, y. — yy) (%1, Yi) + (%2, ya). 
Therefore, property 2 (commutative law) does not hold. 
(ii) (G1, Yi) + Ca, y2)) + (x3, 3) = (2x, - 3X2, Yi — Y2) + (%3, y3) 
= (4x1 — 6x2 — 3x3, y1 — yo — ys) 
(x1, Yi) + (2, yo) + (3, y3)) = (41, yy) + (2x2 — 3x3, yo — 3) 
= (2%; — 6x2 + 9X3, yi — Yo + Y3)- 
Therefore, property 3 (associative law) is not satisfied. 
(ili) 1(xy, yy) = 4/3, y,/3) # (1, 1). 
Therefore, property 10 (existence of multiplicative inverse) is not satisfied. 
Hence, V is not a vector space. 
Example 3.14 Let V be the set of all ordered pairs (x, y), where x, y are real numbers. Let 
4 =(x,, y;) and b = (x2, y2) be two elements in V. Define the addition as 


a+ b= (x1, yi) + 2, Y2) = 1 Xs V1 V2) 


and the scalar multiplication as 


ot halk L(x), V1) = (AX), Hy). 


‘is not a vector space. Which of the properties are not satisfied? 


cay 
ey may i t i fs! 
- ‘ = i a 

a 4 


lution Note that (1, 1) is 


i 
i 
_ 







an element of V. From the given definition of vector addition, we find 
(x1, ¥1) + (ls 1) = Gr yi). 


ent (1, 1). Therefore, the element (1, |) plays the role of 0 element 
in V for which (a) + (— a) = 0 = (1, 1), since 


‘ ‘ nae 2? 
this is true only for the element ( 
‘ed in proverty 4. Now, there is no element 


Cent ees oC ap.—y1) # G, D. 


a 
ty 5 is not satisfied. 
i 2% two scalars. We have 


sei aia oe 
* Py a 8 7 | 


ie 


(a+ BOM y¥1) = 3@4» Yi) = (3x), 394) 
ar. 

; ' 

— 
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ee). ae (Pye 2 
and a(x), y;) + BO, 1) = Ly, Y1) + 201, YW) = Gas Yi) + 2x1, 21) = (227, 27) 


Therefore, (@ + B)(x;, y1) # @ (x), y,) + BCX, yi) and property 7 is not satisfied. 
Similarly, it can be shown that property 9 is not satisfied. Hence, V is not a vector space. 


3.3.1 Subspaces 


Let V be an arbitrary vector space defined under a given vector addition and scalar multiplicatioy 
A non-empty subset W of V, such that W is also a vector space under the same two operations of vecto 
addition and scalar multiplication, is called a subspace of V. Thus, W is also Opies am De tw 
given algebraic operations on V. As a convention, the vector space V 1s also taken as a Subspace of | 
Remark 8 

To show that W is a subspace of a vector space V, it is not necessary to verif y all the 10 properties 4 
given in section 3.3. If it is shown that W is closed under the given definition of vector addition an 
scalar multiplication, then the properties 2, 3, 7, 8, 9 and 10 are automatically satisfied because thes 
properties are valid for all elements in V and hence are also valid for all elements in W. Thus, we nee 
to verify the remaining properties, that is, the existence of the zero element and the additive invers 
in W. 

Consider the following examples: 


1. Let V be the set of n-tuples (x, x.... x,) in IR” with usual addition and scalar multiplication 


Then 
(i) W consisting of n-tuples (x; x ... x,) with x; = 0 is a subspace of V. 
(ii) W consisting of n-tuples (x; x, ... X,) with x; 2 0 is not a subspace of V, since V 
is not closed under scalar multiplication (@x, when q@is a negative real number, is no 
in W),. 


(ili) W consisting of n-tuples (X} Xx 
W is not closed under addition. 


(Letx=(x,; x2 ... x,) with x2 =x, + 1 andy = O1 yo 
be two elements in W. Then 


X,) With x. =x, + lis nota subspace of V, sinc 
Yn) with y2 = y1 + | 


RPV =O ty, wot yo... Xn + Yn) 
iS not in Was x2+ y2=x +y,+24#x, 4 y, + 1), 


2. Let V be the set of al] real 


polynomials P of degre < | + 7 
multiplication. Then eree Sm with usual addition and scalat 


(i) W consisting of all real polynomials of degree < m with P(O) 
(ii) W consisting of all rea] 
since W is not closed y 


= 0 is a subspace of V. 
polynomials of degree < m with P(0) = 1 is not a subspace of V. 


nder addition (If P and Qe W, then P + O¢ W). 


(iii) W consisting of all pol al 
: ynomials of degree < m with real positi jents J {a 
Vsj : | : 11 p IVE: C 3 1S NOt « 


hen =P ¢ W). der scalar multiplication (If P is an element of W: 


3. Let V be the set of all p xX n real 


oie square matrices with usu: Taree scalar 
multiplication. Then sual matrix addition and scala 
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i) Wconsisting of all sy, Anan: | | 
(i) ih g OF all ‘ymmetric/skew-symmetric matrices of order n is a subspace of V. 
(ii) W consisting of all upper/lowe 


iii consisting of ; 1 matric ve ; 
(iii) W £ Of alln x py matrices having real positive elements is not a subspace of V 


ay ig not closed under scalar multiplication (if A is an element of W, then 


4. Let Vbe the set of alln x n, 
Then 


(i) W sale iha of all Hermitian matrices of order n forms a vector space when scalars are 
real numbers and does not form a vector space when scalars are complex numbers 
(W is not closed under scalar multiplication). 


Let Ar Ne gest 
x-ly | 


r triangular matrices of order n is a subspace of V. 


complex matrices with usual matrix addition and scalar multiplication. 


Let @= i. We get aa =iA =[ " i lew 
xi+y bi 


(ii) W consisting of all skew-Hermitian matrices of order n forms a vector space when 
scalars are real numbers and does not form a vector space when scalars are complex 


numbers. 
K l x+y 1 
= EW. 
a —x+iy 21 
—| ix-—y 
Ket @=71. We get 1A — zW. 
=—i1x—y —2 


Example 3.15 Let F and G be subspaces of a vector space V such that F 7 G = {0}. The sum of F 
and G is written as F + G and is defined by 


F+G={f+g:fe F,ge G}. 
Show that F + G is a subspace of V assuming the usual definition of vector addition and scalar 
multiplication. 


Solution Let W=F +Gandfe F, gé G. Since 0 € F and Oe G, we have 0+ 0=0€ W Let 
f+ g) and f, + g> belong to W where f, f) € F and g), 82 € G. Then 


(f, + 21) + (f + 82) = (fi + fo) + (81 + 2) © P+ GW. 


Also for any scalar @, a(f+g)=af+age F+G=W. 


Therefore, W = F + G is a subspace of V. 







NOW present an important result on subspaces. 
y, be any r elements of a vector space V under usual vector addition 


ht Latvia ¥e t of all linear combinations of these elements, that is the set of 


4nd scalar multiplication. Then, the se 
‘ements of the form 
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is a subspace of V, where @, Q,..+, @ are scalars. 


; ‘nations of ye Se UGE 
Proof let W be the set of all linear combinations of Vv), V2, sol 


r 
f - 

Ww) = y avi and W2= 2 bv; 
j= = 


be any two linear combinations (any two elements of W). Then, 
W, + Wo = (a; + by)v, + (az + by)Va +... + (G, + OV © W 
Ow, = (Ga))v, + (May)v2 +... + (Aa,)v, € W 
Ow, = (Ab,)v,; + (@b2)v2 +... + (@b,)V, © W 
and Q(W, + Wo) = Aw, + AW. 
Taking @ = 0, we find that Ow, = 0 € W. This implies that w; + 0 =0+ w; = Ww; 
Taking @ =— 1, we find that (— 1)w,; = (— w,) € W. This implies that w; + (— w,) = 0 
Therefore, W is a subspace of V. 
The elements v;, v3,..., Vv, are in the subspace W as 
Vy, = lv, + Ov. +... + Ov,, v2 = Ov, + lvo+...4+Ov,,.. 


We say that the subspace W is spanned by the r elements Vj, V2, -..-, V,. Also, any subspace that 
contains the elements v), V2, ... , ¥, must contain every linear combination of these elements. 


Spanning set Let S be a subset of a vector space V and suppose that every element in V can be 


obtained as a linear combination of the elements taken from S. Then $ is said to be the spanning set 
for V. We also say that § spans V. 


Example 3.16 Let V be the vector space of all 2 x 2 real matrices. Show that the sets 


, SS Tacepleoms knee) ty...) 
© le Me Ma} 3) 


be an arbitrary element of V, 


a ob ie <C) Y «i 0 O 
a| +b r : 
b : ; : F : 1 4 ‘ al 4) 
Since every element of V can be written as a linear 


S spans the vector space V. 
(i) We need to determine the scalars Qh, 


Solution Let X = i “| 
cd 


(1) We write 


combination of the elements of S, the set 


OX, Oi, Qs, SO that 
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: sje, : + & ae jb 1] oad 
|}c 6d 10 Oo 2/9 ed qa 


Equating the corresponding elements. we obtain the system of equations 
a 
Lt Oe + s+ Ape a, Oat Oat Gy Sd, 
Q3,+ Ay=c, Qs = d. 
The solution of this system of equations is 


Qs= d, A3=c-—d,Q,=b-c,a,=a-b. 


Therefore, we can write 


a d r 6 1 ct A 
=(a-b)| |+o- | a : | |. 
; 0 0 eg | ee ol ln a 
Since every element of V can be written as a linear combination of the elements of S, the set 


S spans the vector space V. 
Example 3.17 Let V be the vector space of all polynomials of degree < 3. Determine whether or not 
the set 
N={e7 +h are} 
spans V? 
Solution Let P(t) = ar + Bt? + yt+ 6 be an arbitrary element in V. We need to find whether or not 
there exist scalars a), a>, a3 such that 
ati+ Bt?+ yt+ d=aPt+ag(t> +) +a,(t?+t+ 1) 
or at3+ Bt2 + yt + 5 = (a, + ay) f° + ant” + (ay +43) t+ a3. 
Comparing the coefficients of various powers of ft, we get 


a, + a3 = @, a2 = B, an + a3 = Y, a3 = O. 


‘The solution of the first three equations is given by 
a,=a+B-%2=B,a=y-B. 










stitutin we obtain y— B= 6, which may not be true for all elements in V. For 
ple, the polynomial + 20? + t + 3 does not satisfy this condition and therefore, it cannot be 
= i f the elements of S. Therefore, S does not span the vector space V. 


tituting in the last equation, 


as a linear combination 0 
*3.2 Linear Independence of Vectors 
vector space. A finite set {V}, V2, - ++ Yn} of the elements of V is said to be linearly 


Pendent if there exist scalars %, 0,-- >> a, not all zero, such that 


ars - QV; + QnV2z +... - nVn = 0. (3.20) 





Peetsted only for & = 02 =---= % = 0, then the set of vectors is said to be linearly 


ee ee 


ion of linear dependence of V1, V2... ., ¥, can be written alternately as follows. 


A175 FC 
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Proof Let the elements v;, ¥2,.... V, be linearly dependent. Then, there exist Scalars 
Q;, Ob, ..., Q@,, not all zero such that 


3 “=: 
OV, + OV Pr Cer vi + OV; + O41 Vi+1 Sa ee 2 OL, ny 


Let a; # 0. Then, we can write 


CL Qs OQ j-] Of i+1 m e220 = 
y.-=— = ¥j—| —/V¥2-..-- 15 fe Of: |Vitel — °° on ft 
a Q; | \ a; Oj i 3 


* __* . 
= OV, + G2V.+...+ Aj 1Vi_y t+ GisiVisr t+ ---+ GnVn 








where @;, @>,..., @;, are some scalars. Hence, the vector vy; is a linear combination of the vectors 


Wis(Woae == » Wet Vite, s* «Ve 
Now let v; be a linear combination of Vi; V2... == 5 Vy, Vig» - - - , V,- Pherefore, we have 
Vj = Vj + GnV2 +... + G;-4Vj-1 + Gigi Viz] +... + 4,V, 
where a;’s are scalars. Then 
CWE FQN a hash Ap Wee (= DV; + Gp Vi Fo... FAV, = O. 
Since the coefficient of v, is not zero, the elements are linearly dependent. 
Remark 9 


Fq. (3.20) gives a homogeneous system of algebraic equations. Non-trivia] solutions exist if 
det (coefficient matrix) = 0, that is the vectors are linearly dependent in this case. If the det (coefficient 
matrix) # 0, then by Cramer’s rule, @ = 02=...=aQ,=0 and the vectors are linearly independent. 


Example 3.18 Let y, = (1, — I, 0), v2 = (0, 1, - 1) and V3 = (0, 0, 1) be elements of IR3. Show that 
the set of vectors { yj, V2, V3} is linearly independent, 
Solution We consider the vector equation 
QV) + QV, + A3v, = 0. 
Substituting for v,, v5, V3, we obtain 
@%(1,— 1, 0) + @&(0, 1, - 1) + a3(0,0,1)=0 


or (Qi, — Of + ,—- + a3) = 0. 
Comparing, we obtain a =0,- a + @=Oand- + 03 = 
Q = & = a; = 0. Therefore, the given set of vectors is linear] 
Alternative 


0. The Solution of these equations 1s 
y independent. 


I o 0 
det(v,, V2, V3) = | —| ] 0 


0 






=1+0. 
at a 








' 
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example 3 3.19 Let v, = (1,-1]. 0), v5 


ae (Oil ee 
ir’. Show that the set of vectors iy, (0, 1,-1,v3=(0,2 


ms » <, 1) and vy = (1, 0, 3) be elements of 


V3 V4} is linearly dependent. 


The given set of elements w; 
Solution SAtS will be linearly denendent if there ac: ) 
jot all zero, such that early dependent if there exists scalars OX, A, Ay, My, 


COV) + Oav, + OV, + Ayvy = 0. (3.21) 
substituting for ¥), V2, V3, Vy and comparing, we obtain 


O+ A,= _ ry 
pig, = 0, 1 + QM. + 203 =0,-a.+ 05+ 3a,=0. 


The solution of this system of equations js 


Q) = - Os, Qs = 3Q4/3, ly, =- 4a,4/3, 4 arbitrary. 


Substituting in Eq. (3.21) and Cancelling @4, we obtain r 


5 4 
“Vit FV a ve+ vee 0 


Hence, there exist scalars not all ZCTO, such that Ea, (3. 21) IS satisfied. Therefore, the set oft vectors 
is linearly dependent. 


3.3.3. Dimension and Basis 


Let V be a vector space. If for some positive integer n, there exists a set S of n linearly independent 
elements of V and if every set of n + 1 or more elements in V is linearly dependent, then V is said to 
have dimension n. Then, we write dim(V) =n. Thus, the maximum number of linearly independent 
elements of V i is the dimension of V. The set S of.» linearly independent vectors is called the basis of 
i Note that a vector space whose only element is zero has dimension zero. 


Pie ares 3.3 Let V be a vector space.of dimension n. Let vj, V2,..., ¥, be the linearly independent 
elements of V. Then, every other element of V can be written as a sea combination of these 


elements, Further, this representation is unique. 





Proof Let v be an element of V. Then, the set oat V},-++» V,} is linearly dependent as it has n + | 
elements. Therefore, there exist scalars Q, @1,--++» Om ; not all zero, such that 
OgV + AV, +--+ + AnyVy = 9. (3.22) 


e get Vv) +... + @,V, = 0 and since vj, Vo,..., v,, are vey 
= a, = 0. This implies that the set of n + 1 perches Vi, Wigan 
t ‘possible as the dimension of V is n. 









z dep € en ndent, v we et —- = &2= 
"nis linearly independent, which i is no 


Therefore, we obtain from Eq. (3.22) 


v= > (—;/Qo )V;" (3.23) 


hoe. vi is linear combination of n linearly independent vectors of V. 


tia there be two representations of V given by 
a - + avn + + AnVn and vy =b,v, + bov2 + - > * OY, 
V=a,v, + 42.27 -- . 
, s one i Subtracting these two equations, we get 
Beat ane i. | 
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0 = (a, — b))v) + (az — 62) V2 +. 6 + (Qn — On)Vp 
Since v), ¥5,..., ¥, are linearly independent, we g 
a-b,=0 or a =6,i=1, 7 i Reese) 


Therefore, both the representations of v are same and the representation of v given by Eq. (3.23) jg 
unique. 


Remark 10 


(a) A set of (mn + 1) vectors in IR" is linearly dependent. 
SQ) A set of vectors containing 0 as one of its elements is linearly dependent as 0 is the linea, 
combination of any set of vectors. 

Theorem 3.4 Let V be an n-dimensional vector space. If Vy, Vo, . ~~» Ve K < im are linearly 
independent elements of V, then there exist elements V,,), Vj.2, -. - » VY, such that {vj, Wane «2.5 Va} is 
a basis of V. 

Proof There exists an element v,,, such that v), V2,..-, Vis Vg, are linearly independent. Otherwise, 
every element of V can be written as a linear combination of the vectors V,, V2,.-., Vy and therefore 


V has dimension k < n. This argument can be continued. If n > k + 1, we keep adding elements v,, , 
Ve+2> +++» V, Such that {v), v2,..., v,} is a basis of V. 


Since all the elements of a vector space V of dimension n can be represented as linear combinations 
of the n elements in the basis of V, the basis of V spans V. However, there can be many basis for the 
same vector space. For example, consider the vector space IR?. Each of the followin g set of vectors 


Qed, OF, 10. t= 19, (0.0 1) 
Gi) [1 = 150], (0,0; A9s[19.39 
(iii) [1, 0, 0}, [0, 1, 0], [0, 0, 1] 


are linearly independent and therefore forms a basis in IR?. Some of the standard basis are the following. 


1. If V consists of n-tuples in IR”, then 


ey = (TN, Or. £70), es = (0: EO sO), E TS GOO, 0 1) 


? 


is called a standard basis in rR, 


2. If V consists of all mx n matrices, then 


Oo ne LO carat) 


Bie SO 8, eA Oi rs 1h Oui ri and a 


Oia 0 


where lis located in the (r, s) location, that is in the rth row and the sth column, is called its 
’ standard basis. i 


For example, if V consists of all 2 x 3 matrice 


a 
: S, then any matrix 
written as 


d in V can be 
ey. 
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X y Z 28 + Eig + chy + xB +yEy +2 Bs 


_ If V consists of all polynomials | | 
standard basis. poynomials P(t) of degree <n, then 1G at ce t"} is taken as its 


fxample 3.20 Determine whether the following set of vectors {u, v, w} 
(i) ut (2, 2. Q), v= (Se Q, 2), i (2. = D 2) 
(ii) U= (Oo, —1), v= (1,0. l), w= Gs 1, 3). 


torms a basis in IR?, where 


Solution If the set (U,V, w} forms a basis in IR3, then u, v, w must be linearly independent. Let 
Ql, Q, O be scalars. Then, the only solution of the equation 


QU + OV + Gw=0 (3.24) 
must be @| = Q> = a = 0. 
(i) Using Eq. (3.24), we obtain the system of equations 
20, + 30%, + 20,=0,2a,-2a,;=0 and 2a,+2a,=0. 


The solution of this system of equations is Q = Q) = @ = 0. Therefore, u, v, w are linearly 
independent and they form a basis in IR®. 
(ii) Using Eq. (3.24), we obtain the system of equations 
— Q + 303 = 0, O, + 03 = 0, — &—- &% + 30, =0. 
The solution of this system of equations is Q@ = Q, = a; = 0. Therefore, u, v, w are linearly 
independent and they form a basis in IR. 





Example 3.21 Find the dimension of the subspace of IR* spanned by the set {(1 0 0 0), 
@1 0 0), (1 20 1),(0 0 O 1)}. Hence find its basis. 


Solution The dimension of the set 1s $ 4 If it is 4, then the only solution of the vector equation 


ad 0 0 0)+% (0 1 O 0) + & @ 
On = Oy = 0. Comparing, we obtain the system of equations 


260 1) 4 e010) Gel) =O (G.25a) 






Should be = & 
: ae = Mat Q,= 0. 


given by 






_~*€ solution of this system of equations Is 
5 i hae Ret at th, = 204, 03 =— where 4 is arbitrary. 
A, = &4 . 


is satisfied for non-zero values of @ 1, 2, @; and 4. Therefore, 





, r 7 
| I ie iT coal ] “a ig - wie” oe , —_ 
ee, the vector equation (3.258) 
; : h Sat a so A 
j sf ot be rb th: =—T « 
4 oat T } i Or ir dh . ‘e set 18 less J an 
iat. a pt Sry - < > 
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Now, consider any three elements of the set, say (1 0 0 0),(0 1 O O)and(!I 2 O 1). Conside, 


the vector equation a 
Comparing, we obtain the system of equations 


0) + = 0, %+20,=0 and O; = 0. 


The solution of this system of equations is 0 = Q) = 03 = 0. Hence, a — “sh meaty 
independent. Therefore, the dimension of the given set is 3 and the basis 1s e Se Vectors 
(1 0 0 0),(0 1 0 0),(1 2 0 1)}. We find that the fourth vector can be written as 


(0 Ceha=a— 0 0 He20 1 0 OF 2 O ZF). 


Example 3.22 Let u = {(a, b, c, d), such that a+c+d=0, b + d= 0} be a subspace of R* 
Find the dimension and the basis of the subspace. 


Solution uw satisfies the closure properties. From the given equations, we have 
adrera=0 and baid=0. of a=—c—d and b=-d. 


We have two free parameters, say, c and d. Therefore, the dimension of the given subspace is 2. 
Choosing c= 0,d=1 andc=1,d=0, we may write a basis as {(—1 -1 O 1),(-1 0 1 Q)}. 


3.3.4 Lnear Transformations 

Let A and B be two arbitrary sets. A rule that assigns to elements of A exactly one element of B is 
called a function or a mapping or a transformation. Thus, a transformation maps the elements of A 
into the elements of B. The set A is called the domain of the transformation. We use capital letters 7, 
S etc. to denote a transformation. If T js a transformation from A into B, we write 


For each element a A, we get a unique element b € B. We write b = 7(a) or b = Ta and b is called 
the image of a under the mapping 7. The collection of al] such images in B js Called the range or the 
image set of the transformation T. 
In this section, we shall discuss mappings from a vector s 
(wo vector spaces, both real or complex, over the same 
V into W. The mapping T is said to be a linear transfo 
following two properties: 
(i) For every scalar w and every element y in V 


Pace into a vector space. let V and W be 
field F of scalars, Let I be a mapping from 
rmation or a linear mapping, if it satisfies the 


T(av) = aT(y), (3.27) 
(1) For any two elements Vv}, Vo in V 


T(v¥, + 3) = T(v\) + T(v5), (3.29) 
: rT space, the product wy and the s 
r defines a mapping from V into W. Since T(y,) 
T(v\) + T(¥2) are in W. The conditions given 


um'Yi + V2 are defined and are elements in V. Then 
Y)) and 7(v>) are in W. the product @7 (vy) and the sum 
in Eqs, (3.27) and (3.28) are equivalent to 

Mav, + B Yo) = Tia v,) + T(@ v5) = AT(v,) + BT(y>) 
for y, and v» in V and any scalars @, B. 
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Let V be a vector space of dimeng sak , | 
I Nension nm and let the set {V}, V2, ..., ¥,} be its basis. Then, any 


Jement Vin V can be written as a iin... ee: 
eleme ritten as a linea combination of the elements v,, ¥5,... , Vi 
sretore, Rey 
The vs OV) + MoVot+... + nV » 
ynere @,, @e,..., @ are scalare Shin ——- ; ; rr ; 
wh ane Calars, not all zero, If T is a linear transformation defined in V. then 


/ (¥V) _ T(@,v, + OV 5 a Vin) 


= P(a)v,) + T(QoVo)+...+T7(a,V,) 
= QL (vy) + QT (v5) +... 4 OT Xv;,). 
Thus, a linear transformation is completely determind by its action on the basis vectors of a vector space. 
Letting &= 0 in Eq. (3.27), we find that for every element v in V 
T(Ov) = T(0) = OT(v) = 0. 
Therefore, the zero element in V is mapped into zero element in W by the linear transformation 7. 
The collection of all elements w = T(¥) is called the range of T and is written as ran (7). The set 
of all elements of V that are mapped into the zero element by the linear transformation T is called the 
kernel or the null-space of T and is denoted by ker(T). Therefore, we have 
ker(T) = {v1 7(v)=0} and ran(T) = {T(v) lve V}. 
Thus, the null space of T is a subspace of V and the range of T is a subspace of W. 
The dimension of ran (T) is called the rank (J) and the dimension of ker (T’) is called the nullity 
of T. We have the following result. 
Theorem 3.5 If 7 has rank r and the dimension of V is n, then the nullity of Tis n — r, that iS, 
rank (7) + nullity =» = dim(V). 


We shall discuss the linear transformation only 1n the context of matrices. 

Let A be an m Xn real (or complex) matrix. Let the rows of A represent the elements in IR” 
(or C”) and the columns of A represent the elements in IR™ (or c”). Ifxisin IR", then Ax is in IR”. 
Thus, an m X n matrix maps the elements in IR” into the elements in IR”. We write 


T=A:IR"—> IR”, and 7x = Ax. 
We now prove that the mapping A is a linear transformation. Let v,, ¥. be two elements in IR” and 
a, B be scalars. Then 

T (a@V,) = A(Q@V,) = @Av, 

T (B V2) = A(B V2) = BA 
and Tr(a vy, + BY2) = A(a@v, + By.) = aAv, + BAvs, 


The range of T is a linear subspace of IR™ and the kernel of T is a linear subspace of IR”. 
ue Tange o is a line | 


‘ Z im and product of linear transformations 
linear transformations from V into W. We define the sum 7; + T, to be the 
wo r transic 





Sv =T7\v + T5V, VE Vv. 
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It can be easily verified that T; + T> is a linear transformation and T, + T> = Tz +7}. 


Now, let U, V, W be three vector spaces, all real or all complex, on the same field of Scalars. | o 
T, and 7} be linear transformations such that 


T,:U3V and 1,:V5W. 
The product 7,7, is defined to be the transformation S from U into W such that 
w=)5Su= T>(T,u), uc U. 


The transformation 7 7, is also called a composite transformation (Fig. 3.1). The transformation TT, 
means applying first the transformation T, and then applying the transformation T>. It can be easily 
verified that TT, is a linear transformation. 


U T, 





TT; 
Fig. 3.1. Composite transformation. 
If T, : V— Vand T, : V—> Vare linear transformations, then both 7,7, and TT, are defined and 


map V into V. In general, T,7, # TT. For example, let A and B be two 


nm Xn matrices and x be any 
element in IR". Let 7, and T, be the transformations 


T\(x) = Ax and T>(x) = Bx 
from IR” into IR". Then 
T,(T;(x)) = BAx and T| (T>(x)) = ABx. 
Therefore, TT, # T, T, unless the matrices A and B commute. 


Example 3.23 Let T be a linear transformation from IR? into IR2 defined by the relations 


| l 

Tx = Ax, A= 2 3 A 
45) 6 

Find Tx when x is given by [3 4 5)". 


Solution We have 


: rl Sa | 
Tx = Ax = : 2 3 Al = 26 | 
ab * San G ah (62 


Matrices and Bigey dnl - 
t wenvilie Mrobleny 4448 
Example 3.24 Let Tbe a ling 


A’ Cansformation Hetined by 


| 
1/0 | | 
HG IHC OEE} of: 
| | |} | ie a i | - | 7[ | ei 7 
: \ | ’ () | | 





Fin 13 alt 


Solution The matrices | ; | 2 1] 
form a basis in the space of 2 x 2 


od 





OiTo 6 
SVD? Lea? i 


matrices, We write for ANY SCAlANS Of), Q, Oy, Gy, Hot all zero 


wy 0 | O10 
«| " «a +a | ae 
bl oe: 9 tig yk Pe) dha 


X, XY) + Qs 
(XX) + Mo + Qs Qi + At Ay t Ay 








ave linearly independent and hence 


i 





Comparing the elements and solving the resulting system of equations, we get @, = 4, @» = | 
Q@3;=—2, &, = 5. Since T is a linear transformation, we get 


As oll droll droll Nee’ 9) 





1) 1). f-1) (-2 
7 = 4|2]+41/-2]-2/-2/+5] 2/=| 20], 
: (3 3) or Nee She cee lee Speen bt 









Example 3.25 Let 7 be a linear transformation defined by 


* Ach. 0 | 


i er) ee ; 
-d Tx = Ax, where Al {pee Gun? 


Solution Let (9), y >)! be the point that is mapped into (3, 2). Therefore, we have 


= > abalszh 


=» 
a : , 
| ae ing we obtain the system of equations y, + 2y) = 3, 3y, + 4y) = 2. 


, = _ — 7; , 
ana compal 
eee 






paring te ot 
system of equations Is yy = — 4, yp = 7/2. 


- 
0 ae as) 
or th iS 
aa 










a 
x 4 
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7 r | rr _ l ‘ i / ‘ i I}2 
Example 3.26 For the set of vectors {X), X2), where x) = (1, 3)’, X= (4, 6)", are in IR , find the 
matrix of linear transformation 7; IR* — IR“, such that 


TX ee z2 4 Jf and Tx, =(-2 4 1O)!. 


i 


Solution The transformation 7 maps column vectors in IR* into column vectors 1n IR“. Therefore 
T must be a matrix A of order 3 x 2, Let 





ay b, 
A= ils b» 
ad 4 b 1 
Therefore, we have 
ay b, , ee ay b, ie 2 
a5 b 5) = and dy b ? |= — 4 |: 
3 6 
dy b, _ ads h 4 | _ 10 
Multiplying and comparing the corresponding elements, we get 
a, + 3b, = — 2, 4a, + 66, = — 2, 
dy + 3b, = a 4a, + 6b, =- 4. 


a, + 3b3 = —-7, 4a, + 6b, = — 10. 


Solving these equations, we obtain 


re Mey 
A=|-4 2 
ie hd 


Example 3.27 Let Tbe a linear transformation from IR? into IR*, where 7x = Ax. A = | me? ' | 
=, ar) : 


x=(x y z)!. Find ker (7), ran(T) and their dimensions. 


Solution To find ker(T), we need to determine all vy = (UV; v0 
Ty = Av = 0 gives the equations 


3° such that Tv = 0. Now 


U,;+U,=0, -v,+v,=0 
whose solution is v; =~ v5 = v4, Therefore y = Os et at 
Therefore, dimension of ker(T) is 1, 


Now, ran (T’) is defined as {T(v) | v « V}. We have 


Tv) = Av =| l : a U, + U2 | 
ae 0 l r. —U,; + DU, 
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= | ‘ + vag + oa) 
af | . hy 
| l) (1) (0 ; 
Since ¥ m 0 i the dimension of ran (T) is 2. 
Example 3.28 Let T be a linear transformation Tx = Ax from IR2 into IR?, where 
2 | 
A=/1 -1] and x=(?| 
3 2 : 
Find ker (7), ran (T) and their dimensions. 


Solution To find ker(T), we need to determine all v = (v, v2)" such that Tv = 0. Now, 
Ty = Ay = 0 gives the equations 


2U; +U2=0, v;-v,=0° and 3, + 2v,=0 


whose solution is v; = v2 = 0. Therefore v = (0 0)’ and the dimension of ker (7) is zero. 


2 ! 2 | 
Nav V} 
Now, ran = 7 Gy) Sill eI 5 =v,| 1}+0,}-1}- 
Bie Dit 3 2 


smcere 1 3)’, (1 —1 2)' ate linearly independent, the dimension of ran (T) is 2. 


Example 3.29 Find the matrix of a linear transformation T from IR? into IR? such that 


{1 6 by. (2 l 6 
Ti l = 2 5 Ia —l/= —4 - fh =) — 6 : 
I 4 1 2 3 5 


\ Solution The transformation T maps elements in IR? into IR?. Therefore, the transformation is a 
he - trix of order 3 x 3. Let this matrix be written as 





Gj 2 G3] 
=|B; B2 Bs |: 
Vt Fo 3 


6 
B> B; —2|=/ 6). 
| 15 





Weioe 3 13/2 |. 
| 1 2 
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sar 3 in | defined by 
Example 3.30 Let 7 be a transformation from IR° into IR 


7 7 p) 
wf ce i —. 7, Seay 
T(x) \ PT) 5 *X4 ) = X | + x A, + 4 


Show that 7 is not a linear transformation. 


- ‘& | 
) be any elements in IR~. Then 
Solution Let x = (x,, x9, 3) and y = (1, Y2, 3) be any two 


, 4 
K+ y = (X) + Vp X2 + V2, %3 F V3): 


We have 
, 4 : 2 2 2 
PX) = co tat XS Tiyya=yy + Yo * ¥3 
T(x + y) = (x, + y))° + Go + y>)° + (x3 + y3)° # T(x) + TQ). 


Therefore, 7 is not a linear transformation. 


Matrix representation of a linear transformation 


We observe from the earlier discussion that a matrix A of order m Xn is a linear transformation whic 
maps the elements in IR” into the elements in IR”. Now, let T be a linear transformation from 
finite dimensional vector space into another finite dimensional vector space over the same field F. \ 
shall now show that with this linear transformation, we may associate a matrix A. 
Let V and W be respectively, n-dimensional and m-dimensional vector spaces over the same fiel 
F’. Let T be a linear transformation such that T: V > W. Let 
x= {¥j, Vos 2 ey eae Y= {W), W2,---; Wr} 


be the ordered basis of V and W respectively. Let v be an arbitrary element in V and w be an arbitrar 


element in W. Then, there exist scalars, a, 0), ... a, and B;, Bo, . . ., Bn» not all zero, such that 
V= QV, + OhV7+...+ GV, (3.29 1 
w=f,w, + Bowit+...4 Bn Wm (3.29 i 
and w=Tv=T(aQ,v, + Wor =. .+ Oy.) 
SST Wi On Ee ot a, T v,, (3.29 iil) 


Si V ) iE is 7 eee sea . ; 
Since @ ery element PV, ES Lys - 118 in W, it can be written as a linear combination of the basis 
oo Wir W2,- + +» Wm In W. That is, there exist scalars a; i= 1, 2 m= 1. 2 n not all 
Zero, such that y ie ae > J — 5 wey ee gy / 
LV; = ay:W, + a5; . 
t ae 3; W aa me os Arn; W 


mM 


= [Wy Wo. : ) ee 
Weal (tps Aa... Ami], t=1,2,..., 0 (3.29 i) 
Hence, we can write 
30 Bie ae ip, 
i 
. md 2 me Pe 
a 
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where A ts the m X n matrix 


ay] a)2 ne Q) », 

Rew a>) a orev Arp, 
el & (3.29 vi) 

Ay | Am? tee Amn 


The m Xn matrix A is called the matrix 


representation of 7 or the matrix of T with respect to the 
ordered basis X and Y. It may : E 


: ae be observed that X is a basis of the vector space V, on which T acts and 
Y S the basis of the vector Space W that contains the range of 7. Therefore, the matrix representation 
of P depends not only on T but also On the basis X and Y. For a given linear transformation T, the 
elements aj of the matrix A = (@,;) are determined from (3.29 v), using the given basis vectors in X 
and Y. From (3.29 iii), we have (using (3.29 iv)) | 


W = Gy (ay,W) + Q21)W2 +... + Qn Wm) + Op(ayow) + Axx W2 +... + AnaWm) 
+... t+ A, (G1 )W) Gg Water e AmnWm) 
= (Q) ay, + Op a). +... + G&, ay,) W, + (Qi Az) + Ondx7 +. . . + A, Ar,)W2 
Hs $ (QE yy + On Oy + os + OG, ) Wr, 
= Bw, + Pow. +... + Bw», 


where B; -_ Of, aj, = aj? fee OCC 1 Gins a Vs z. =e ey 


Bp, Qy| a2 ses Gin || Q 
B; a2) 492 -++ Ady || Qo 
Hence, eo) |S=9! he | 
; foam | Im Am? ese Amn X, 
or B=Aa (3.29 vii) 


where the matrix A is as defined in (3.29 vi) and 
B = [Pi. Bs. cn Py. Bl’; a= [ Q, OQ, wos ey a)". 


-a given ordered basis vectors X and Y of vector spaces V and W respectively, and a linear 
formation T: V > W, the matrix A obtained from (3.29 v) is unique. We prove this result as 








‘ ieA= (a,j) and B = (b,;) be two matries each of order m X n such that 
—) TA=YA and TX= YB. 
YA=YB 


., Wm} is a given basis, we obtain a,; = b;; for all i and j and hence A = B. 


a _ oT 
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Example 3.31 Let T: IR? > IR? be a linear transformation defined by 


Bh 


yrtz 
T| yi = 
| ioe 


Determine the matrix of the linear transformation 7, with respect to the ordered basis 


| Oil eesti 
O/+inIR? and Y= } | in IR“ 
ko)’ (a) 
| 


(standard basis e;, @>,e; in IR? and @;, é>, in IR). 





iNT EY C4 

(ii) X= 4} 1},/0],| 1|/$ in IR? and Y= (obs) tim 
1) \l Q WIM 
((0) (1) (1 

(ii) X= 4) 1],| 0},] 1]}in R$ and r= {('}, Alas 
Li} (1) lol] ake 


Solution Let V= IR’, W= IR’. Let X¥ = {vj, vy, v3}, Y= {wy, w>}. 


] Q 
: l 0 
(1) We have Vv, =| 0],v. =/ 1]|,v3 = of. wi=[o}wa=( 2] 
0) O : 


We obtain 


7 


{-6)-We-()° 
i a (0) +()o 
(al =(a}e+()}-0 


Vv), that is TX = YA, we write 


I| 


0 
T| 0 
heb 


Tr ing the notation given in (3.29 
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7a jj 
T Iv, « ¥4q, V3] = [w, Ww >| 
MD ade»v &] 


0 


EEA tI 


Therefore, the matrix of the linear transforma 
given by 


or T 





tion T with respect to the given basis vectors is 


Bee l 0 
(ii) We have Wy) 1),¥2 =)0 |, v4 = ifm=[ohme=(1] 


We obtain 


()-(o-(im 
(ede 
()-G)e-()6 


' 1 "i ‘ 
ry [ay ’ a 
* 4 i i 
‘ : a 
“ alk ee x 
u 
% 
e 
7 * — 
il % ; \ t 7 f 1 
Di | om lie) 
ah ia Ah i Li a, " j 
|) | HEIN FON | F2 L 4 
| | } ) i ; 
| | s i | 
. | “ \ . ° } d i | j | : i 
T a hil a ia | a | ov 
J Di | iT : . ~*~, 
bal i . | ~ : | | ' | { i } 
| Toy vt f Wt  - 2 eo — a | 
=» =! | Wi, BY ly Ky mee} ‘ue : —ae 
3 z J 1 } ii ‘1 } 
: ' Tt | i i | ' Nie 
] ' 7 i i ‘ i 7 
| ao 4 ll \igy A 4 
; : oh ogee to, et 


i ik 


ri : a. 1 =r ; re + “VT = er ) 7 | 
‘the near TAalloaliVilil 
| i. Le Bee Lu — ri t 
ee a te — » ; 









with respect to the given basis vectors is 
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i | | ; 
= , WwW -— 
(iii) We have ace | Faas Ova = | bh a 2 - 
| | Q) 


We obtain 


fH OeCo-Ce 


Using (3.29 v), that is 7X = YA, we write 


AHH ROGUE ts 


Haka ] () 


Therefore, the matrix of the linear transformation T with respect to the given basis vectors 1s 


given by 
i Oe 1 
A= | 
fit 


Discuss whether V defined in Problems 1 to 10 is 
of the properties are not satisfied. 


Exercise 3,2 


a vector space or not. If V is not a vector space, state which 


1, Let V be the set of the real 


polynomials of degree < Fe pice : = 
scalar multiplication, gree Sm and having 2 as a root with the usual addition and 


Pe 


Let V be the set of all real polynomials of degree 4 or 6 with 
Let V be the set of all rea] polynomials of degree > 4 with 
Let V be the set of all rational numbers with the usual 


the usual addition and scalar multiplication, 


= 


the usual addition and scalar multiplication. 


Raa 


addition and scalar multiplication. 


numbers w; We : 
mbers with addition defined as x + y = xy and usual scalal 


wm 


Let V be the set of all Positive rea] 
multiplication, 
6, Let V be the set of all ordered pairs bx 


F j y. l 2 ] ; wr ~ 
(x + u, y + v) and scalar multiplication 4 y) in IR? with vector addition defined as (x, y) + (4, ¥) * 


efined as A(x, y) = (Bax, y). 
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et V be the set of all ordered t+; | | 
a wu eplets (XY, 2), x, y,Z€ IR, with vector addition defined as 


(X, y, z) + (4, UV, w) = (3x + 4u, y-2 
and scalar multiplication defineg as 


U,Z+ Ww) 


A(x, y, z) = (ax, Oy, 2/3), 
g. Let V be the set of all positive rea] 


he numbers with addition defined as x + y = xy and scalar multiplication 


bh 
9, Let V be the set of all real valued continuous functions fon {a, b} such that (i) | f(x)dx =0 and 


b 
(ii) | f(«)dx =2 with usual addition and scalar multiplication. 
4 


10. Let V be the set of all solutions of the 
(i) homogeneous linear differential equation y” — 3y’ + 2y = 0. 


(ii) non-homogeneous linear differential equation y” — 3y’ + 2y = x. 
under the usual addition and scalar multiplication. 


Is W a subspace of V in Problems 11 to 15? If not, state why? 


ll. Let V be the set of all 3 x 1 real matrices with usual matrix addition and scalar multiplication and W 
consisting of all 3 x 1 real matrices of the form 


a a a a 
fe ||, (ii) Ja |, (ii) |b], (iv) |b} 
a+b é || 2 0 


12. Let V be the set of all 3 x 3 real matrices with the usual matrix addition and scalar multiplication and 
W consisting of all 3 x 3 matrices A which 


(1) have positive elements, (ii) are non-singular, 


ae a 
(iil) are symmetric, (iv) A°=A. 


13. Let V be the set of all 2 x 2 complex matrices with the usual matrix addition and scalar multiplication 
: Meas 1S X+1y 
and W consisting of all matrices of the form ig 4 

q (i) scalars are real numbers, (ii) scalars are complex numbers. 

| 14, Lat or att real polynomials of degree < 4 with the usual polynomial addition and scalar 
. ; duultiplication arid W consisting of polynomials of degree < 4 having 
ties a (ji) coefficient of 1? as 0, 

i) coefficient of ¢° as 1, 
5. Let V be the vector space of all triple 
multip and W be the set of trip 


I where x, y, z, & are real numbers and 









a (iv) only real roots. 


triplets of the form (%), *2, x;) in IR? with the usual addition and scalar 
lets of the foém (x, X2, X3) such that 


(ii) x, = %2 =%3 + is 





: 2 2 <A 
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17. 


18. 


19. 


20. 


21. 


22. 


23. 


25. 


26. 





D 


y ’ 
amar, 
P se 


ne) ‘ail 





@ (& 1-4, ©, O, 3k~1, 2) 


(iii), (— 2, 1, — 9). 


Rie | (ii) 3, 2, 5); 
(i) (4, 3, 10), (2, 3, 1, — 1). Determine whether or not x is a ling 


Let u = (1, - 2, { 3). Vail, 2= i, 1) and w= 
combination of u, v, W, Where x Is given by 

(i) (G, 0, 5,-— 1), (ii) (2,-7, 1, 11), 
Let P,(t) = —4t- 6, P2(t) = 21 2 — 8. Pi) = 2t = 
P(t), when 

(i) P(t) =—-1t7? +1, 
Let V be the set of all 3 x 1 real matrices. Show that the set 


(iti) (4, 3, 0, 3). 


3, Write P(t) as a linear combination of P,(1), py, 


(ii) P(t) = 2t? - 3t — 25. 


1 1) (0) 
S= 2) 1],| -L}],| O];7 Spans V. 
| 0 0) \l 


Let V be the set of all 2 x 2 real matrices. Show that the set 


rf 3G HC HE hom 


Examine whether the following vectors in IR?/C? are linearly independent. 
(i): (2) 2 1h = 1, DD, COs), Gi) 92933), Sly (G, 7, 8), 
(iii) (0, 0, 0), (1, 2, 3), G, 4, 5), Gy): 2, 1,—= DIX =3, 4); i, = 1,5); 
(vy) C1, 3,4), G, 1,0), G, 45-2); d, = 2,1). 
Examine whether the following vectors in IR* are linearly independent. 
Wi Geely 2; =), C1 1,:05,3), G,— 1, 0,.2), (= 2),.1,.0, 3), 
(i) i; 2,3, 1), (2) L, = 1,1); 4, 5,5, 3), G, 4, 1, 3), 
Gi), (8 2-3,.4), (2:0) 1 = 2)Gy ara oy, 
(iv) (, 1,0, 1), 1, 1, 1, 1), @1,-1, 1, 1), C, 0, 0, 1), 
(v) SCl,.25:3,—. 1) (Os; = 1, 2), (hd; 1,8) Cl 78: oy 
If X, y, Z are linearly independent vectors in IR3, then show that 
(l) X+y,y+z,z2+x; (li) XX+y,x+y4z 
are also linearly independent in IR3. 
Write (— 4, 7, 9) as a linear combination of 
Show that S is not a spanning set in IR3. 
Write 1° + ¢+ 1 as a linear combination of th 
5 is the spanning set for all polynomials of 
Let V be the set of all vectors in IR4 
(i) @, y,-—y, — x), 
(iii) (x, 0, z, w), 
Find the dimension and the basis of 5. 


Fotonbatwalues 9 4 k do the following set of vectors form a basis in IR?? 


(—£,.1, 0)}, 


the elements of the set S : {(1, 2, BNG115)-4); GB, 1. 2))- 


€ elements of the set § : (32, 22-1, 22 + 24 + 2}. Show th 
degree 2 and can be taken as its basis. 


and S be a subset of V consisting of all vectors of the form 


(il) (, y, z, w) such that x+y +z-—-w=0, 
Gv) (@, x, x. x). 
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(ii) {(K, 1, 1), 0, 1, 1), (&, 0, &), 
(iii) ((k, kB, (0, k, kb), (k, 0, B), 
(iv) {(1, &, 5), (1, —3, 2), (2, -1. 1)). 


28. Find the dimension and the basis for th 
(ii) symmetric matrices, (iii) 
A= (a) with ay, + a2, = 0, 


€ vector space V, when V is the set of all 2 x 2 (i) real matrices, 
skew-symmetric matrices, (iv) skew-Hermitian matrices, (v) real matrices 
(vi) real matrices A= (aj) with a,; + dj2= 0. 


29. Find the dimension and the basis for the vector space V, when V is the set of all 3 x 3 (i) diagonal 
matrices, (11) upper triangular matrices, (iii) lower triangular matrices. 


30. Find the dimension of the vector space V, when V is the set of all n x n (i) real matrices, (ii) diagonal 
matrices, (111) symmetric matrices, (iv) skew-symmetric matrices. 


Examine whether the transformation T given in problems 31 to 35 is linear or not. If not linear, state why? 


| x 
a 7: IR? > R' : r(*) =xX+y+a,a#QO, a real constant. 


x 
oll X+Z 
ra 


2 
33, T:IR' > R’*; T(x)= . } 


x 


0 x#0,y#0 
c, a ey 
34, T IR? sR'i7{*) = i2y, x=0 


13x, y=0. 
oN 
35. T:IR? — R';T| y| =xy +x +z. 
Z 


Find ker(T) and ran(T) and their dimensions in problems 36 to 42. 







2x+y 

fs 

37. r+ RT| (=| y— = |. 
3x4 4y 


Ty’. 


39. rm? RT|") = x+y. 


a re 3. i 
, _ : [x : 
= a | 
“3 — Si juego (a A By 
pea: 71) vy) =x + y- 
; a a mei ES | a 


eae ly 
| Nee ae 
Me 


I 


= Te oo ie x-y 
41. re? 7 Jf ’) 
AY x-y 





B 
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43. Let 7: IR’ — IR? be a linear transformation difined by 


ar . 
x+y) 
Tr) y| = , 


es 


| T wi 26 he ordered basis 
Find the matrix representation of T with respect to the ordered 


ih iy oy 1) (0). 
‘ i 4 —_ : ] i 
(1) A 2+ Q | | in IR- “and Y 0} £ | 
Was 
a) 1) (2) 
(11) X=;/0)|, | 11], | 1)}in IR° and Y= 3) 5 in 
1} lo} U3 : 


44. Let V and W be two vector spaces in IR’. Let 7; V-— W be a linear transformation difined by 


x | () 
NL S| = yy 
Wed X+y+z 


Find the matrix representation of T with respect to the ordered basis 


Pay 160) 1) (0 oy 

(i) A= 9/0), )1),|1]¢inv and y=4/0]/,/ 1] 10 in W 
Wy Oy a 0} \o | 
1) (0) (0 Le (Le 60 

(ii) N= 5/0) /1),/O}pinv and y= dio} Jal |, in W. 
0) \1 Ll) lo} (4 


45. Let Vand W be two vector spaces in IR3. LetT: V-+Whea linear transformation defined by 


x ei IF 
Hy | = X+y 
X X+y+z 


Find the matrix representation of 7 with respect to the ordered basis 





1 \ eT —|]| 
X= l/+inV and | a | eee Li.) -l}} in w 
=I Seen 4 
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7. ne? —s 1R® he a 1; 
46. Let T: IR° > IR” be a linear transformation defined by 


+ 
- J 
; TZ 
/ y — y 
A+ Zz 
ae | 
x+y+z 


Find the matrix representation of T with respect to the ordered basis 


ay" Q | l | 
: ci Pe 0 l ] 
X= 4|0},) 1],]1]}in R? and y= aol, “W et, in IR 
Veal 1/}1/ to 
1 l 0 
47, Let T: IR* — IR® be a linear transformation. 
12 
Let A=|2 3 | be the matrix representation of the linear transformation T with respect to the ordered 

3 40 


basis vectors v, = [1, 2], vp = [3, 4]” in IR? and w, = [-1, 1, 1)’, w2=[1,-1, 1”, w3 =U, 1, =i]? in 
IR? . Then, determine the linear transformation T. 
2 


A) 
: | be the matrix representation of 


| | 
48. Let T: IR? — IR’ be alinear transformation. Let A = ; 


the linear transformation with respect to the ordered basis vectors v; = [1, -1, 1]’, v2 = [2, 3, -1]’, 
¥,= [1 0-1)" in IR? and w,=[1, 1)’, w2=[2, 3]’ in IR* . Then, determine the linear transformation T. 


eg 52 
49, Let T: P\(t) > P(t) be a linear tansformation. Let A=| 2 3 be the matrix representation of the 
=I 1 


‘linear transformation with respect to the ordered basis [1 + ¢, ] in P,(t) and [1 —1, 27,2 + 3¢—-1°] in P(0). 


Then. determine the linear transformation 7. 

vk. 4 = - | f (x;, X2, %3) in IR° satisfying (i) x, — 3x. + 2x, = 0; 
50. Let V be the set of all vectors of the form (1, *2, %3) Se I 2 aes 
Sa s % = 0 and 4x, + 5x2 = (0. Find the dimension and basis for V. 

(il) 3% — 2X2 + 43 = 













: P| |e 
| ee, ee? he 


yeral Linear System of Equations 





atrix method and the Cramer’s rule for solving a system of 
on eee ed that the coefficient matrix A is non-singular, that 1s 
a tn A is n. The matrix method requires evaluation of n> determinants 
7. 1) + oenerate the cofactor matrix, and one determinant of order n, whereas the 
: mA ge a of (n+ 1) determinants each of order n. Since the evaluation of high 
pe le tae consuming, these methods are not used for large values of n, say 


e WeTV 
“ hi A = ry 


ve have discussed the m 
unk Ax = b. We assum 


Ys A 

, ae* (ey 1 
} i 7 68 CUO | 
' é of 


emery” 
1 ey! yt 





b-.. 


| i > 1 | | ’ “4 E ) | : 2 | y J Z ( f t | j } 
; | 





given by | 
Ax =bD C3; 
Xx] 
aj, 412 ain 
X49 
Qn, 8422 Can b= Syl 
where A= j 
x 


are respectively called the coefficient matrix, right hand side column én a the — vect, 
jer | atrix 
The orders of the matrices A, b, x are respectively m x n, m X l and n X 1. The ma 


ai 1}? ree Ain D; 

a> 4) ce ayy b> 2 ; 
(A | b) = oF 

am| GA m2 sce Aimnn Dm, 


is called the augmented matrix and has m rows and (n + 1) columns. The augmented matrix descrit 
completely the system of equations. The solution vector of the system of equations (3.30) is 
n-tuple (x), x2, . . . , X,) that satisfies all the equations. There are three possibilities: 
(1) the system has a unique solution, 
(ii) the system has no solution, 
(iii) the system has infinite number of solutions. 
The system of equations is said to be consistent, if it has atleast one solution and inconsistent, if ith 


no solution. Using the concepts of ranks and vector spaces, we now obtain the necessary and sufficie 
conditions for the existence and uniqueness of the solution of the linear system of equations. 


3.4.1 Existence and Uniqueness of the Solution 


Let V,, be a vector space consisting of n-tuples in IR” (or C”). The row vectors Bey» «natty; OF t 
m Xn matrix A are n-tuples which belong to V,. Let S be the subspace of V,, generated by the ro\ 


of A. Then, S is called the row-Space of the matrix A and its dimension is the row-rank of A and 
denoted by rr(A). Therefore, 


row-rank of A = rr (A) = dim (S). (3.3: 
Similarly, we define the column-space of A and the column-rank of A denoted by cr (A). 


x Ser the row-sp ace of m Xn matrix A is generated by m row vectors of A, we have dim(5) SI 
since S is a subspace of V,, we have dim(S) S n. Therefore, we have 


. rr (A) < min (m, n) and similarly cr (A) < min (m, n). (3.3: 
SIPRAA, Let 4 = (4) be an m Xn matrix. Then the row-rank and the column-rank of A are sa 


ig ah wi = a, Mee of A. The dimension of 5 is the number of linearly independent fo 
AE OAS OF S be r. Therefore, r rows of the matrix A are linearly independent and tn 


= 
—— 
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remaining * — 7 TOWS can be written 
the linearly independent rows of re 

R 4) 
R 


as " “ : 
os a linear combination of these r rows. Let Ry, Ro, so, R, be 
en, We can write 


— rR, T M7412 R + oe ieee = 0 re ee ae 


Na Crip F' Gago Rye... + 742, Ry 


R,, = Qin Ry + On 2 Ro . ee Goa ak, 


where @;,; are scalars, 
refore, the jth element : AI: 
The , he J of the row R,4) iS given by 
qd — 
ney Or ays Or+1,2 2; aoe Saree al 8 i ae a yj 


Similarly, the jth elements of the rows R_,, R.. can be written 
Beals seen 


Hence, the jth column of the matrix A can be written as 





| 0 0 

0 l 0 

Q 0 0 

0 os aj 0 + _ a,j 1 
O41] : Or 41,2 Orel or 
Om] Om ,2 Om r 


Thus, every column of the matrix A can be written as a linear combination of r linearly independent 
rows of A. Therefore, the dimension of the column-space cannot exceed r, which is the maximum 
number of linearly independent rows of A, that is 
cr (A) < r= row-rank of A. 
Simi arly, by reversing the roles of rows and columns in the above discussion, we obtain 
rr (A) < r= column-rank of A. 


Combining the above results, we have 
"hg rank (A) = rr (A) = cr CA or. 
| ult which is known as the fundamental theorem of linear algebra. 











Now, we prove the important res 
*heorem 3.7 The non-homogeneous sys 
solution if and only if the matrix A and 
iven system of equations Ax = b as 


tem of equations Ax = b, where A is an m Xn matrix, has 
the augmented matrix (A | b) have the same rank. 


‘ite the g 


x, C, +%2C2a+-- .+x,C,=b (3.34) 
ihete C. is the ith column of A. Thus, finding solution of the system Ax = b is equivalent to finding 
AS x), x, .. . , x, which satisfy the equation (3.54). 


The above operations performed on columns (th 
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he matrix (A |b) is 7 and r Sn. Therefore 
these are the first r columns,. Then, the 
i combination of these ; linearly 


Let rank (A) =rank (A | b)=+r. Then, the column-rank of t 


there are r linearly independent column vectors. Suppose thes 
C,,4) can be written as a lines 


remaining columns C,41, Cp42. «+ | = sell cieisapiaiat 
{)th column of (A | b) is a linear combination of its firs, 


independent column vectors. Thus, the (1 + 


n columns, that is 
D= OQ, C; + OQ Cy + er (X,, ¢ n 


which means that Aw = b, or Ax = b has a solution. 
Conversely, let Ax = b have a solution, say x = a. Then, we can write 

b=a,C,) + Co+...+ &%C, 
Thus, the column-spaces of A and (A | b) are the same and have the same dimension, Since, these 
dimensions are rank (A) and rank (A | b) respectively, we obtain rank (A) = rank (A | b). 
Remark 11 
A system of linear equations Ax = b is consistent, if the vector b can be written as a linear combination 
of the columns C,, C;,...,C, of A. If b is not a linear combination of the columns of A, that is, b 


is linearly independent of the columns C;, C2,..., C,, then no scalars can be determined that satisf\ 
Eq. (3.34) and the system is inconsistent in this case. 


In section 3.2.3, we defined the rank of an m Xx n matrix A in terms of the determinants of the 
submatrices of A. An m Xn matrix has rank r if it has at least one square submatrix of order r which is 
non-singular and all square submatrices of order greater than r are sin gular. This approach is very time 
consuming when n is large. Now, we discuss an alternative procedure to obtain the rank of a matrix. 


3.4.2 Elementary Row and Column Operations 

The following three operations on a matrix A are called the elementary rew operations: 
(i) Interchange of any two rows (written as R; ~ R ios 
(ii) Multiplication/division of any row by a non-zero scalar (written as @R,) 


(iii) Adding/subtracting a scalar multiple of any row to another row (written as R, <— R. + aR 
that is & multiples of the elements of the jth row are added to the cortesn SNj — Kj + AK) 


the ith row. The elements of the j 
Ae jth row remai ay tye ¢ 


onding elements 0! 
the elements of the ih 


These operations change the form 
| : orm of A but do not change the rc | 
row-space of A. A matrix B is said to be row eq tA as they do not change the 


from the matrix A by a finite sequence of deine ia toa matrix A, if the matrix B can be obtained 
We observe that | » ATY TOW Operations. Then, we usually write B= 4 


quivalent to C, then A is row equivalent to © 
at is column j eat 
column in place of row) are called e/ementa’ 


ha? 


PA) 


oe PO SS oF. 
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) ae 
,4,3 Echelon Form of a Matrix 
n matrix is called 4 ro . | 
An m Ow echelon matrix or i row echelon form if the number of zeros 


7 1e first non-zero | 
receeding the “AO entry of a row " | . } 
pre y W Increases row by row until a row having all zero entries 


er elimination ys possible) is ohiniwy 
for no Oo st lane €) is obtained. Therefore ee , “fab 
rollowing are satisfied. Ore, a matrix is in row echelon form if the 
niachank 


vg Ov 
1S true Tor all subsequent rows. 





(i) If the ith row contains al] Zeros, it 

(ii) Ifa column contains a non-zero ent 
is zero, that is, if the ith and (i + 
entry of the (i + 1)th row appears 


ry of any row, then every subsequent entry in this column 
l)th rows are both non-zero rows, then the initial non-zero 
In a later column than that of the ith row. 


(iii) Rows containing all zeros occur only after all non-zero rows. 


For example, the following matrices are in row echelon form. 


Me 7 ull =f, 25 ‘ee 
O § 1,;0 OO 3 : : : ; | 
OOF 0 OI)0 oo @ 6 ’ 

ao Oo Om Oo 


Let A = (aj) be a given m Xn matrix. Assume that a,,; #0. If a;, = 0, we interchange the first row with 
some other row to make the element in the (1, 1) position as non-zero, Using elementary row 
operations, we reduce the matrix A to its row echelon form (elements of first column below a); are 
made zero, then elements in the second column below a>, are made zero and so on). 








Similarly, we define the column echelon form of a matrix. 


Rank of A | The number oon zero Jows in the row echelon form of a matrix A gives the rank of 
the matrix A (that is, the dimension of the row-space of the matrix A) and the set of the non-zero rows 


in the row echelon form gives the basis of the row-space. 

Similar results hold for column echelon matrices. 

Remark 12 

(i) If A isa square matrix, then the row-echelon form is an upper triangular matrix and the 
” column echelon form is a lower triangular matrix. 


(li) This approach can also be used t 












o examine whether a given set of vectors are linearly independent 
OF not. We form the matrix with each vector as its row (or column) and reduce it to the row 
| - Side in) echelon form. The given vectors are linearly independent, if the row echelon form 
‘has no Tow with all its elements as zeros. The number of non-zero rows is the pai of 
i ato f vectors and the set of vectors consisting of the non-zero rows is the basis. 


» 3.32 Reduce the following matrices to row echelon form and find their ranks. 
é 3.32 Reduce the following ™ 





| pe 3. A 
a S| Wigs]. 405 

ay (ii) ie Seln Be 7") 
4 ide 
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Solution Let the given matrix be denoted by A. We have 


LP 3s pile ee a ad 
| le py ke om : 2/0. -7 -6|Rat2ks ~|9 ae 8. 
(i) A=| 2 Ry +2R, a larger ; ; 
—2 8 


| in the row echelon fo 
This is the row echelon form of A. Since the number of non-zero rows 1n the n fort 


is 2, we get rank (A) = 2. 


1 2 3 4 
Ry-“Ri {5 3 -2 -3|Ra+Ro 
ee ait. Se. 3 ee or are. 3|R4—5R2 
i dae wl OC lo ts 10=C- 15 
ee ee: 
Jesu 2 
ae. eT 
6 6 6 





Since the number of non-zero rows in the row echelon form of A is 2, we get rank (A) =2 


Example 3.33 Reduce the following matrices to column echelon form and find their ranks. 


reales ers 24 ma Sie 2 
(1) aie iti > 3h (ii) . 
of te 1S tf bpm ah vay 





2 4/C,-C,/3 c, 
ie ieee l a/3 3/3 es, l 5 0 
ee ee Ws. 73) 3 C=) -7/3 0} 
SERBS) 2 1/3 1/3 2 fs. 0 
Since the column echelon form of A has two non-zero columns, rank (A) =2 
It Le = I 
se Lie lie 9 aac ae 
(ii) -_ C —] 204 9) 6, £30 
Co e1 = 


ote § 4 | Ca C, : = 2 1} C,+C, 
— 2 4 2 
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| ~ ». Gg 

me -2 O. O| 
4 L =] O60 @6! 
ae eZ iQ’ 0 


Since the column echelon form of A has 2 non-zero columns, rank (A) = 2. 


gxample 3.34 Examine whether the following set of vectors is linearly independent. Find the 
dimension and the basis of the given set of vectors. 


(i) (i, a, >) 4), (2, QO, F ei 2), (3, ‘La 4, Zz), 
fia tis ts, 1), (1, 1, 1, 1), 1, I, 1, 1), 4, 0, 0, 1), 
(iti) (2, 3, 6, — 3, 4), (4, 2, 12, — 3, 6), (4, 10, 12, — 9, 10). 


Solution Let each given vector represent a row of a matrix A. We reduce A to row echelon form. 
If all the rows of the row echelon form have some non-zero elements, then the given set of vectors 
are kinearly independent. 





+2, 3 2 3 
(i) Awia 0. 1 SS 
a Pe 





ee 4 
=|0 -4 -5 -10}. 
pores OO 0 









ee all the rows in the row echelon form of A are not non-zero, the given set of vectors are 
e pe | apa Since the number of non-zero rows is 2, the dimension of the hie set of 


pi 0,1, 0) (00,0, 1) ote given staf fos the bans 


goons 
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3 
: Z 0 3 —Z R,+R, 
FE -F 4 R,-2"1 _|9 -4 


on 6 : p 3 4 
= : = Oh a 
(ii) A=(4 2 12 -2 “JR, 2m |g 4 
{ 10 1-9 ™ 
2 g 0G =p 4 


OeniiAewiOin me Saree 
0 (mds @ 0 


il 


ro, the given set of vecto,... 
n-Zero, the gi ~LOTS are 
| shelon form of A are np He jimension Of the given <a, .. 
Since all the rows in the row ec rows is 2, the dime : SIVEN set 
: Sj ber of non-zero | 4 0.3.—) 
linearly dependent. Since the num he set ((2y 3. © — 3, 4), (0, — 4, U, 3, — 2)}. 
vectors is 2 and its basis can be taken as {he Set \\% 


stems 
3.4.4 Gauss Elimination Method for Non-homogeneous Sy 


7 : ; in nm unknowns 
Consider a non-homogeneous system of m equations In 1 


Ax=b (3.35) 
ayy ay2 Gin by PED 
Ay, 422 «++ Ga» b> | x2 
where A=] . =e. ex |. 
Sm Gad, ers Bane b,, x 


We assume that at least one element of b is not zero. We write the augmented matrix of order 
mxX(n+ 1) as 


a)| a1 <i al Bs 
“2; a 


ay Q)5 
0 a4 





where r < m and 411*0,4,,%0 
J. 


We have the Vt) a anole * . 
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(a) Let r<m and one or more of the elements b 


* * * | 
| r+is9r.2,..., 6. are not zero. Then rank (A) 
rank (A | b) and the system of equations ha ‘i 


S no solution. 

(b) Let m 2 n and r= n (the number of columns in A) and b7,,,b7,.,...,b* are all zeros. In 
this case, rank (A) = rank (A | b) = p and the 
solve the nth equations for Xn, the (mn — 1)th 
called the back substitution method 


system of equations has a unique solution. We 
equation for x,_; and so on. This procedure is 


For example, if we have 10 equations in § 


| variables, then the augmented matrix is of order 
10 x 6. When rank (A) = rank (A | b) =5 1 


he system has a unique solution. 
* 


r+l> b>. 5 ee b> are all zeros. In this case, unknowns, Eis Hey 00 ing Ky CON 
be determined in terms of the remaining (7 — r) unknowns Xrel> Xpy2s ++ +X, by solving the rth 
equation for x,, (r — 1)th equation for x,; and so on. In this case, we obtain an (a — r) 
parameter family of solutions, that is infinitely many solutions. 


(c) Letr<nand b 


Remark 13 







(a) We do not, normally use column elementary operations in solving the linear system of equations. 
When we interchange two columns, the order of the unknowns in the given system of equations 
is also changed. Keeping track of the order of unknowns is quite difficult. 


(b) Gauss elimination method may be written as 


(A | b) Elementary (B | c), 


row operations 
The matrix B is the row echelon form of the matrix A and ¢ is the new ri ght hand side column 
vector. We obtain the solution vector (if it exists) using the back substitution method. 
(c) If A is a square matrix of order n, then B is an upper triangular matrix of order n. 
(d) Gauss elimination method can be used to solve p systems of the form Ax = b,, Ax=bs,.. ., 
Ax=b ‘which have the same coefficient matrix but different right hand side column vectors. 
‘We form the augmented matrix as (A | b;, bo, = sip bp), which has m rows and (n + p) columns. 
Using the elementary row operations, we obtain the a of wpe on CB} eyieac& ., e.); 
yhere B is the row echelon form of A. Now, we solve the systems Bx = ¢,, Bx = ¢, . . 


a § 












‘a 
La 
si , 
—— = 7 oo 
nentcu 
a ,. ——_— 


® 


6 a 
-2 


a 


matrix and reduce it to row echelon form by applying elemen tary 
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jy 4 
_4|R3+ 5R,/3 
F3 fl A Ry - Ry/2 _ ah. 5/2 ‘ 3 2 
ae D, 
@) (A|b)=| 1 -1 2)-4lp 4 Ry/2 5/2 —3/2 
24 SEAN IG 
2 1 -l 4 
210 =3/2 S/2| =a) 
0 0 8/3} -8/3 | 
‘ain the solution as 
Using the back substitution method, we obtain 
8 _ 2 OF g=—, 
5 ee 
Bec ee, or y=l, 
Tig) igi 4 
x+y-z=4, or x= I. 
uti = — 8 oe 
Therefore, the system of equations has the unique solution x = 1, y = I, 
: Ze 0 ] 3 
tt ee 12 1R,—2R 
a) (AID =]b mt 1 ees 1/2 | 1/2 |r; - 22, 
42, BB eee ees T| kg 
2 0 ] 3 
= 10 24 1/2 lage. 
Over) 2G Ont) 
be vie that rank (A) = 2 and rank (A | b) = 3. Therefore, the system of equations has no 
sOlUTION., 
1 -1 1 
= = 1| 1 
(iii) (Alb)=/2 1 Ry aR a 
>). 2 5 R3- SR, -3]0 R;- R, 
+ 4) 4310 
et ae 
=) () 3 
0 0 





The system is consistent and 
is satisfied for all values of : utions. : oh the act equation 
the first equation, we get ‘s ec, pias rend ©quation le a i i ee: From 
y = Zand z is arbitrary, ie he etefore we, obtain the solution * = 


has infinite number of so] 
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mple 3.46 Solve the follow; 
example OhOwing systems of equati 7 
» OF equations using Gauss eliminati 
‘ a ae ae £ Gauss elimination method. 
2x + 3y+3z+6w =6 
4x -2ly -39z-6w =~ 24 


(ii) xX 2y —2z =] 
2x-—3y+2z = () 
5x + y= 5z = | 

3x + 1l4y — - 
solution We have i iettigs hal 


(i) (A |b) 
& -3 -9 6 
no 3 5 66 | 
fas 2l —96 _¢ 


4 -3 -9 6] 0 
0 9/2 15/2 3] 6/R3+4R, 
|® =18 -30 —12]—24) 





=9 6/0 
L522 3:) Gil. 
0 0/0 





The system of equations is consistent and has infinite number of solutions. Choose w as 
arbitrary. From the second equation, we obtain 


9 15 2 Le | 
7+ 7 2=6— 3w, or y= 3 (6-30-32) = 44-52-20) 


From the first equation, we obtain 
4x = 3y + 9z —-6w = 4-—5z-2w+ 9z-6w=4+ 42 - 8w 
or eae — 20 


Rank (A/8) Sid 
Rank (Af) Sa 


“Wa @a) 


Thus, we obtain a two parameter family of solutions 
xe=l+z—2w and y=(4—-5z-2w)/3 


where z and w are arbitrary. 





lbs ee eT 
Poe | le OR, 
2 ae) i 0 R 5R na 0 =i 5 —2 R3- 9R./7 
a ae 110 -9 5|-4]R4+ 8R2/7 
Rash est lee! 
fei4 -12)5 : . 
, 9 1] 2 -2 1 
: ime 0 -7 5) 2 
—7 > A Ry —IR3 = 
9 10/7 | -10/7 QO -10/7 | —10/7 
0 0 0 





all values of x, y, z- From the third equation, we obtain 
1. Hence, the system of equations has a unique 


st equation is satisfied for 
— 7R, + R3)/5, the last equation is redundent. 


Was tion gives ¥ = x= 


ar 7. at 
a 
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| ,ations 
a Equatio 
3.4.45 Homogeneous System of Linear ©4 
quations 


AX = () } 


. 3 @ 
Consider the homogeneous system ot 


Ig 


consistent since x = 4 ? 

1 is always re 
system 
Noy 


ank (A | 9). Therefore, for the homoge 
ane cank (A) <n. It rank (Ay =. r 
ich form a vector space of dimension (ne, 


; eneous 
‘is an m X n matrix. The homoget\®” 
where A is an ym X nm matrix vail (A) 


solution) is always a solution. In this CA oa feanile 
system to have a non-trivial solution, Sa aaae 
we obtain an (n — r) parameter family of so 


arbitrarily. oe. 
: — r) par be chosen arbitrar! | : _ 
as (n — r) parameters can 1s system is called the null space and its dimension jg calle 
The solution space of the homogencot 
the nullity of A. Therefore, we obtain the result 


| , 5) a 
rank (A) + nullity (A) =” (see Theorem ) 


Remark 14 Be ie 
1S: : 1 + PX 18 also a solu, 

(a) If x, and x, are two solutions of alinear homo geneous system, then i 4 ee ae ats tuo 

of the homogeneous system for any scalars @, B. This result does not hold for non-homogenegy; 


systems. 
(b) A homogeneous system of m equations in n unknowns and m < n, always possesses a non. 
trivial solution. 


Theorem 3.8 If a non-homogeneous system of linear equations Ax = b has solutions, then all these 
solutions are of the form x = xp + x; where Xo is any fixed solution of Ax = b and X;, 1S any solution 
of the corresponding homogeneous system. 


Proof Let x be any solution and Xo be any fixed solution of Ax = b. Therefore, we have 
Ax = b and AXo = pb. 
Subtracting, we get 


Ax-Ax)=0, or A(x-—x,) = 0. 
Thus, the difference x — Xo between any solution x of Ax 


Remark 15 


If the non-homogeneous system Ax =h 

u yster =D Where 
1s, rank (A) = n, then the corre 3 
1S X, = 0. 


IS anim x y matrix 


sponding homogeneo (mn) has a unique solution, (4! 


US Systern | 
system Ax = 0 hac Only the trivial solution, (4! 


Example 3.37 Solve the follow; 
owing hemogeneay 
‘ System of e 


: | 1 quations Ax = 0, where A is give" DY 
3 2| (ii) | l 1 | ] —] | 

Find the rank (A) and nat a, 2 63 f 4i. 

nd the rank (A) and nullity (A), | —.. , 


Beata We write the augmented matriy (A | 0) 
~~ “ST 0) ang reduce 
It to TOW e 





Matrices and Eigenvalue Problems 3.59 


2 0}, 4 ik ; gs 

(i) (A]%=/ 1 -1/0 a= Ri /2 4 
|. (Ry=—3R 79 7|9 3/2) 01Ry4+- 2/3 = 1/0 3/2) 011, 

i) 10) f@ 
ot 0 1/2] 0 0 0|0 


Since, rank (A) = 2? = nhumbe 


r of unknowns, the syste ivi lution. Hence 
nullity (A) = 0, system has only a trivial so 3 


l 


2 -310 + 3} 0 
i) (AL%=]1 1 -1]0|*2>* healt do ai 
(it) (A | | | 5a 0 R,-R, - 0 —| 2 0) R,-—3R3 = 0) —| 


Since rank (A) = 3 = number of 


unknowns, the homogeneous system has only a trivial 
solution, Therefore, nullity (A) = 0 


=) 116 Mf taste” eticg 


tl Ke On Pet =P To 
mane / 27 =f 
(iii) (A]0)=]2 3 AHO T sap, 8/0 Ted 21Q|RapBon | 0, 293 2) 01 
3 IN, 
ae 36° 216 OP S13). 2810 00 0 0]0 


Therefore, rank (A) = 2 and the number of unknowns is 4. Hence, we obtain a two parameter 
family of solutions as x, = - uae ~ > Ae Xy = — 2X2 + X3 — Xy = 4x3 + xy, where x3 and x, are 
arbitrary, Therefore, nullity (A) = 


34.6 Gauss-Jordan Method to Find the Inverse of a Matrix 
Let A be a non-singular matrix of order n. Therefore, its inverse B = A“! exists and AB =I. Let the 
matrix B be written as B = [b,, b>, . . . , b,,], where b; is the ith column of B. 
From AB = I, we obtain 
AB = Alb), bo, ... -»» Dal = 1= Uh, ta. « . . Il. (3.37) 
Where I, is the column vector with | in the ith position and zeros elsewhere. Using Gauss elimination 
— = solving n systems with the same coefficient matrix (see Remark 13(d)), we form the 











AVE, foes. <> bo which is same as (A | J, 
Where I is the identity matrix of order n. Using elementary row operations, we obtain 
Nere Tis the identity m 


Elementary (I | B) 
row operations | 


i (A |D (3.38) 


we B> 3 = A-! This method is called the Gauss-Jordan method. In the first step, all the elements 
ome: the pi pivo Reet made zero. In the second step, all the elements above and below the second 
i é . a a AL te ith step, all the elements above and below me oO aj Ak are made 


: icky snes-Jordan wr find the inverse of the matrix 
cai aN 


aye St #4 
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Solution We have 





—| ie) i 0 0 
(AI=| 3 -1 19 1 4 


The pivot element a,, is — 1. We make it 1 by multiplying the first row by — 1. Therefore, 


i 1 =2/=) 0 0 al 2h oO 


5 | 
R—3R) | Ms 
As Ste a ORIN O27) 3 1 OC RG/2 
R3 +R, 1 0 
a 3 a OO Q) 2s @RE ed 7 
[== | = =O 46 2 i o 3/21 1/2 1/2, 0 
= 1 232 12 alee = eliOe hate s200l2 0 (—R;)/5 
a ai R;-—2R, — 
2 BDila=is oO | ji 0 =—s1—4.—], 1 
| ior = 710 2710 3/10 
i 0 3/2)! 12° 1/2 0 R-3R,/2 | Pe. 
=(0° Lf F/213/2 12 0), ee me i Ol—13/10 —2/10 1110 | 
ome ls sasils 1/5 e * 00 1 4/5 iin 1/5 
Hence, 
=a | es 
A= 7, | -13 —2 Tike 
Ds 2h 9 


Exercise 3.3 


Using the elementary row operations, determine the ranks of the following matrices. 





faa ip meals (=o 3 a 
bas 3 |. ee es eae "= L |, 
i Ss i 3 fr =9 
I =] eres Ne Me , 
4.12 3 Ades Pie “tae oe 2 ge i" : 
= eee ee eee =I) 
S13 14 
ATP) Ley si] MH a) 0 
‘ reas ") Stptigg ——  * 
ae: a a | 1 a | a. 6) 
ike es a ieee x? ...6 
3 Oy as 
| i i 
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mentary column operat i 
psing the elementary mn Operations, determine the ranks of the following matrices. 


1 [=] | 
6 1 ” ly 2 i te 3 38 
1 ow aae -1 1]. 13: | 10 FP Be Sil 
3 4 53 4 +5 
LS 
; 3 i oN 
14. F a 15. nee sh | 
Ee a1 63.20) Spi 
4 6-5 


4 3 <1 5 





Determine whether the following set of vectors js linearly independent. Find also its dimension. 


16. {(3, 2, 4), (1, 0, 2), (1, - 1, - 1)}. Df 2G — te 1, ON). 
18. {(2, 1, 0), (1, — 1, 1), (4, 1, 2), (2, -3,3)}. 19. (2, 2, 109@) £1) (le =a, 2) 
20.) {G, 1.1); 1,5); (1 + i, — 1-7, dD}. 21a LG ale 15 lode ye Oe Pk), Ue Ooh) 


fom (ln 2.3, 1), 2, 1, —1, 1), G, 5, 5, 3), (4, 1,3)}. 
gamle 2) 34), ©, 1, = 1, 2),.(1, 4, 1,8), G7, 8, 14)}. 
pee 0) 1), 1, 1, 1), (4: 4; 1,1), G1, 0, 0, 19). 
5 12. 2,0, 2), (4, 1, 4, 1), G, 0; 4, 0)}. 


Determine which of the following systems are consistent and find all the solutions for the consistent systems. 


hr 
~ 
— bt 


1 
33. |1 
1 


35. 
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ap z oe tha following 
Find all the solutions of the following homogeneous systems Ax = 0, where A is given as the following 


3 2 | | 2 3 fi 5 
46. | =2 Bi ay. |) 3 Pe il 38. |4 i =ag | 
| 5S 4 ee ee ee 4 9 -6| 
2 -!I —3 I ] l l a 
jl 23 4 l | l ye = | ns 
4% I FF 4 M01 teagan fee ee | | 
oe ee 24 5 9 l I 4 1 
on) ier: 1 lL = aT [ =< 4] 
“) a 
I Sea = | 3 ] —9 3 
42. oe 8 43. 44. ; ie. 2 | 
wee 17 = 83 | anon 57 =i | f 
AAO CA) 3 See ieee 7 oe 4 Sy e9 2 -1] 
ee 9 hed 
Pe 25a Loe? 
witeage = = 
4 3 2 =4 





mnlet, ie Sahl ' 
46, 0 2 Bil AT 1 1 383 48. ; . | 
i 3 4 e ie 2: | 
: l l 4 
1 1 | ] bE. 196 4 
=i | l v1 r sie 
49, . 50 
=] l l Bes AI 
l J * 22] 1 i 310) 0 “a 


3.5 Eigenvalue Problems 


Let A = (a,) be a square matrix of order n. T 


he matrix A may be singular or non-singular. Conside! 
the homogeneous system of equations 


AX=Ax or (A-AI)x=0 (3.39) 
where A is : scalar and I is an identity matrix of order n. The homogeneous system of equations (3 39) 
always has a trivial solution. We need to lind values of A for which the homogeneous system (3.39) 


8 of A, for which non-trivial solutions of the homogeneous sys'*" 


5 : fea } es ‘a 7" le : 1 5 ff a" 
he eigenvectors or the characteristic vectors of A. If x is 4 ” 
system (3.39), then ax, where is any constant is also a oo 
F | eI t ; 4 a 2 % d ( C 
©, an eigenvector is unique only upto a constant multiple. !” 


trivial solution of the homogeneous 
of the homogeneous system. Henc 
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m of determining the elgenvalyec . | 
roblem OF ra 2 i S€nvalues and the corresponding eigen tnt Sh; 
ies meIBerVGIhe Prootem. genvectors of a square matrix A is 
cal 


45.1 Kigenvalues and Eigenyectors 


,omogeneous system (3.39) h- > 
hos “ as than a le nt aly “jon-trvial solu 4.SOlution, then the rank of the coefficient matrix 
(re Ais avant » we Coefficient matrix must be singular Therefore, #3 


ai,-A a)\> een. Ain 


det(A =) =| °2 Ao,—-—A oes Gy 0 eae 
, = Vs 3.40) 


Gy) Gn? in Gee A 


Expanding the determinant given in Eq. (3.40), we obtain a polynomial of degree n in A, which is of 
the form 

Prd) =| A-AT| = 1)"[A" —c, A + cy A. + 1)"e,] = 0 
fee cy tA. + (= 1)". = 0. (3.41) 


where cj, C7,..., C, Can be expressed in terms of the elements a; of the matrix A. This equation is called 
the characteristic equation of the matrix A. The polynomial equation P,,(A) = 0 has n roots which can 
be real or complex, simple or repeated. The roots Aj, Ay, ..., A, of the polynomial equation P,,(A) = 0 
are called the eigenvalues. By using the relation between the roots and the coeificients, we can write 


Ki + A» +...¢A, =C; =a $49 TV wee T Oye 
A, A> a A, A3 + oe +A, An =C) 


A) Ar vee Ap = Cy. 
If we set A = 0 in Eq. (3.40), we get 












A | = (— Bie n — Cy = A; Ay tear pe Rin: (3.42) 
pa sum of eigenvalues = trace (A) and product of eigenvalues = | A |. 


d the spectrum of A and the largest eigenvalue in magnitude is called 
ee & and is denoted by p (A). If | A | = 0, that is the matrix is singular, then from 
ul radius of A an ; be eigenvalues must be zero. Conversely, if one of the eigenvalues is 
Da Aes ea > a sig diagonal or an upper triangular or a lower triangular matrix, 
then Bete 0. Nowe of the matrix A are the eigenvalues of A. 
a A;’s, we solve the homogeneous system (A — A ;I)x = 0 for each 


sponding eigenvectors. 


__ The set of eigenvalues is calle 


After determining the eigenvalues 
“fs A a. = . 
sf eigenvalues and eigenvectors 


es i... ire correspondin 
nvalue of A and x be its corresp y.! 
a : | carresponding eigenvector Is X. 
—. Ax = AX = GAX = (AA)x. 





g eigenvector. Then we have the following results. 








al 
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hs 


. A™ has eigenvalue A” and the corresponding eigenvector is x for any positive integer », 
Premultiplying both sides of Ax = Ax by A, we get 
AAx = AAx = AAx=A(Ax) or A’x=A*x. 
Therefore, A? has the eigenvalue A* and the corresponding eigenvector is x. Premultiplyin, 
successively m times, we obtain the result. 7 
3. A —&lI has the eigenvalue A — k, for any scalar k and the corresponding eigenvector js x. 
Ax=Ax=> Ax-—kIx=Ax-kx 
or (A —kI)x = (A-k)x. 
4. A™ (if it exists) has the eigenvalue 1/A and the corresponding eigenvector iS X. 
Premultiplying both sides of Ax = Ax by A7|, we get 
AtAx=AA7"x or A x=(I/A)x. 
5. (A — kD) has the eigenvalue 1/(A — &) and the corresponding eigenvector is X for ar 
scalar k. 
6. A and A’ have the same eigenvalues, since a determinant can be expanded by rows | 
columns. 


7. Fora real matrix A, if @+ iB is an eigenvalue, then its conjugate a — if is also an eigenval 
(since the characteristic equation has real coefficients). When the matrix A is complex, th 
property does not hold. 


We now present an important result which gives the relationship of a matrix A and its characteris 
equation. 
Theorem 3.9 (Cayley-Hamilton theorem) Every square matrix A satisfies its own characteris’ 
equation, that is ee 7 : 
A"—c,A"™'+...4+(C Dc, ,A + (-1)"c,1 = 0. (3.4 
Proof The cofactors of the elements of the determinant | A — AI | are polynomials in A of degr 
(n — 1) or less. Therefore, the elements of the adjoint matrix (transpose of the cofactor matrix) are al 
polynomials in A of degree (m — 1) or less. Hence, we can express the adjoint matrix as a polynom 
in A whose coefficients B,, B2, . . . , B, are square matrices of order 7 having elements as functic 
of the elements of the matrix A. Thus, we can write 
- De l | 7% 
adj (A — AT) = B, A" + BA"? +... + B,_, A + B,,. 
We also have 
(A — AT) adj (A-AD =| A-AIII. 
Therefore, we can write for any A 
A Se ea 5. n—-2 | ; : | ro ao ‘ np 
(A-AINB, AN + BAP +... +B A+ B= Al — cA 1s 4K etc, Al + (- 1) 
iparing the coefficients of various powers of A, we obtain 
i: B, =I 
oon AB, -B;= oI 
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RG Pc 
| | B, (— 1) ra ot 


AB, — (— l)Ke, [. 


premultiplying these equations by A”, Ami 
An Ant oy AST respectively and adding, we get 
a ni 

| + ‘ + (— 1) Pe Ae (— lYc. lt =e 
which proves the theorem, 


Remark 16a We have for any non-zero vector x 


Ix = |x 
Ax = Ax 
A’x = J?x 


Atk = Ax, 
Multiplying these equations by (— 1)"c,,, (—1)""'c,_4,...,(- 1)c,, 1 respectively and adding, we get 
teh X th (1) Ax +. oe (— Lic, APs + APx 

= (— 1)"c,x +(- 1)"'e,,Ax+...+(- le, At x + A"x 
or [(A”—c, A" +...4+( 1) ¢,,A +C1)"c, 1x 

= [A"-c,A"' +... + 1)"6,.44 + (C D"c,] x = Ox = 0. 
ince x + 0, there is a possibility that 

Amc AM 4. FC Do APE De IEO 








2 1ark 16b 
Bre can use Eq. (3.43) to find A” (if it exists) in terms of the powers of the matrix A. 











Pr remul tiplying both sides in Eq. (3.43) by Aq! we get 
tan AAT +. Den ATA + © Dep A= AO = 0 


* a aati - Ee. pete rane os OE 1 og KT) (3.44) 


se Eq. (3.43) to obtain A” in terms of lower powers of A as 
Anac AT! -c,A™? +..-+C Deal. (3.45) 


theorem for the matrix 


fy Cayley-Hamilton 





—— 
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sof A. 


of those of A, (iii) find the spectral radiu 
A is given by 


Solution The characteristic equation of 
1-A 2 () 


\A-al[s| -1 1-4 2 
i 2-1-3 


si Aya - 4) -4) - 21-0 - 4) - 2) 





, we 
= (1 - AYA? - 24 - 3) - 2A - 3) = - A" + 3A ~-A+3=0 
ri 2 Of t 2 4 
Now  Ael-t 1 2-1 1.2/=} 4 
feo SL a ae 7 f 
al 4 wiry 2 io «12 
A=A7A=| 0 3 4]/-1 1 11 10 
0 6 S51 2 16 17 
We have / 
| | leat wo 
-l 16 








eee 


| 
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A*- 347 +A-3=0 or (A=3)(A?+1)=0 or A=3,i,-7. 


The characteristic equation of A’ is given by 


[-l-A 4 4 
0 3-A 4 |=(C1-A)[G-A)S-A) - 24] =0 
0 hb. Sed 
or (A+ 1)(A>-8A-9)=0 or (A+ 1)(A-9)(A+ i) = 0. 


The eigenvalues of A? are 9, — 1, — 1 which are the squares of the eigenvalues of A. 


(iii) The spectral radius of A is given by 
P(A) = largest eigenvalue in magnitude = max [Aral 3: 
in Os 3G 


1 O  1/|, then show that A” =A”? + A?2-I for n > 3. Hence, find A’. 
Oo ft 6 





Solution The characteristic equation of A is given by 


fae Oe 
PAH AZES| Yk 81 SO aaa Do wet = 22 44 1 0. 
a) ee ee 


Using Cayley-Hamilton theorem, we get 
A?—A?-A+I=0, or A?-A?=A-I. 
Premultiplying both sides successively by A, we obtain 
A>-A*=A-]I 
A*—A>=A*_-A 


A! i Me — A™3_ ar 
A"— A™! = A™? — Ard 
Adding these equations, we get 
A"—A*=A"*—I, or A"=A™?+4A2_] n>3. 
Using this equation recursively, we obtain 
A" = (A"~* + A*—1) + A*?-T=A™4 49/42 _1) 
= (A"™* + A*-1) + 2(A?-D =A™ 4 3(A2—1) 


— An—(n-2) 44 = 2 Mt 1 
id +9 (m— 2A? 1) = 2 a2_1 (yay, 
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ro oO i’ Oo 0 Q 
A 95A2~ 247 =25/1 1 O|-24/0 1 O/}F= i Ol. 
yay 2 aL! A. I po.) 3 


Example 3.41 Find the eigenvalues and the corresponding eigenvectors of the following matrice, 


8-9 
(i) A= H (i), Ay= | (iii) A= foe FL 
i. sl 2 OQ 3 
Solution 
(i) The characteristic equation of A is given by 
|A -AI|= ey , =-0 or A*-3A-10=0, or A=-2,5. 
3 8) a 








Corresponding to the eigenvalue A = — 2, we have 
| 3 4 | O | o A | 
(A+ 2x =( 2 ile! -[5| OT 3x, +4x.=0 OF X,;=- aot: 


Hence, the eigenvector x is given by 


ea fe | a 
~~ — = X97 | b 
| X94 Ad | 


Since an eigenvector is unique upto a constant multiple, we can take the eigenvector as 


[- 4, 3. 
Corresponding to the eigenvalue A = 5. we have 


—4 4 Xx] 0 
(A — 5]I)x = ¢ allel = ‘ OF A — 42 =0, Or x =x. 


Therefore, the eigenvector is given by x = (x), x2)? = x,(1, 1) or simply (1, 1)7. 

(ii) The characteristic equation of A is given by 
=a 
a | ae 


Corresponding to the eigenvalue A = 1 + i, we have 


[A - (1 UE i)I)x = f ‘ia = is 
| —] —{ | X4 0) 


or — 1x, +x=0 and =a — tae = 0! 

_ Both the equations reduce to — xy 
eigenvector is x = [— i, 1]" 

Corresponding to the eigenvalue A = | — i, we have 


| A -—AI| = 





A or A°-2A+2=0, or Aa14i. 







(iii) 
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LA - (1 -i)I)x = : 5 ie | = i 
—l ii| x2 0 


or IX) +xX,=0 and -—x,+ix, =0. 


Both the equations reduce to — x, + i x2 = 0. Choosing x, = 1, we get x, = i. Therefore, the 
eigenvector is x = [i, 1]’. 


Remark 17 


For a real matrix A, the eigenvalues and the corresponding eigenvectors can be complex. 
The characteristic equation of A is given by 


l-A 0 0 
[A—AE|=|} 0 2-4 1 WsOicer (1 —4)G—A3:—A)'=0 
| 2 0 3-A 
ora = 1.2.3. 
Corresponding to the eigenvalue A = 1, we have 
0 O 0 XY | 0 | 
i) + 43> 0 
(A. — Bxe= 07 2 2 ies a0) 08 
X,+X3z=0. 
2 OF e2iilixs 0 
We obtain two equations in three unknowns. One of the variables x,, x2, x3 can be chosen 
arbitrarily. Taking x; = 1, we obtain the eigenvector as [— 1, — 1, 1]”. 


Corresponding to the eigenvalue A = 2, we have 





or x, = 0, x, = 0 and x, arbitrary. Taking x, = 1, we obtain the eigenvector as [0, 1, 0]’. 


Corresponding to the eigenvalue A = 3, we have 


— 2 (Q) QO xX 10) 

Si OF Bile Six ze O| or - ‘ae 

(A. - 3I)x = | - : X¥2+x3=0. 
2 T° 6 | x3 0 


Choosing x, = 1, we obtain the eigenvector as [0, — 1, 1]’. 


xample 3.42 Find the eigenvalues and the corresponding eigenvectors of the following matrices 








) bok 0 I~ Oo 9 
Woe (ii) A=|O 1 O|, (iii) A=/O0 1 O|. 
1 o 0 1 10. 0) 00 
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- 3 
: in tt wracteristic equation as (1 — A) = () 
. e obtain the characteris | | 
leet ach of the above problems, w , AE lly 
a Pa . ie envalues are A = 1, 1, 1, a repeated value. Since a 3 x 3 matrix : oe nvalues 
: ere os “ Aaa whether the given matrix has 3 linearly independent eigenvectors or it ha, 
it is importan | 
lesser number of linearly independent eigenvectors. 


in tl | ige rs. 
Corresponding to the eigenvalue J = 1, we obtain the following eigenvecto 


0 0 0 AF = 0, 
(i) (A=—T)x=|/0 OF 1)/x= 0} or 4x3;=0 
OiesOrncD 0 x, arbitrary. 
Choosing x, = 1, we obtain the solution as [1, 0, OJ’. 
Hence, A has only one independent eigenvector. 
0 l 0 x] 0 ae 0 
(11) (A-—I)x=|0 O QO 1] x2 )= Ol, or guek sittvacy. 
0 0 0) X4 /O 


Taking x, = 0, x3 = 1 and x, = 1, x3 = 0, we obtain two linearly independent solutions 
X= (0/0) 1/7, x = [1, 0,0)". 


In this case A has two linearly independent eigenvectors. 


6 mor tolls, | 1 
(iii) Qx 0) 6 0illesh= hol 
Q 0 O || x3 0 


This system is satisfied for arbitrary values of all the three variables. Hence, we obtain three 
linearly independent eigenvectors, which can be written as 


x; =[1, 0, 0], x, = [0, 1, 0)”, x, = [0, 0. br. 


We now state some important results regarding the relationship between the ei genvalues of a matrix 
and the corresponding linearly independent ei genvectors. 


1. Eigenvectors corresponding to distinct eigenvalues are linearly independent. 


2, ) " is . eigenvalue of multiplicity m of a square matrix A of order n, then the number 
oF ‘nearly independent eigenvectors associated with J is given by | 


P=n-r, where r= rank (A — QJ), l<p<m 
Remark 18 | 


In Example 3. I the eigenval wie 
aaa s ‘ample 3.42 the eigenvalue J = 1 is of multiplicity 3. We find that in 


(i) Example 3.42(i), the rank of the matrix A — J jg 


tele i ie = a a 1 4 [ 

eigenvector. 2 and we obtain one linearly independent 

ey (ii) Exam ple 3.42(ii), the rank of the matrix A —J[ js | a d . | andent 
-—-« &lgenvectors. nd we obtain two linearly indepen 


< 2 
_ wr 
rn 
' 1; a 
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(iii) Example 3.42(iii), the rank of the matrix A — I is 0 and we obtain three linearly independent 
eigenvectors. 


3.5.2 Similar and Diagonalizable Matrices 


Let A and B be square matrices of the same order. The matrix A is said to be similar to the matrix B 
if there exists an invertible matrix P such that 
A=P'BP or PA=BP. (3.47) 
Postmultiplying both sides in Eq. (3.47) by P~', we get 
PAP =B. 


Therefere, A is similar to B if and only if B is similar to A. The matrix P is called the similarity 
matrix. We now prove a result regarding eigenvalues of similar matrices. 


Theorem 3.10 Similar matrices have the same characteristic equation (and hence the same eigenvalues). 
Further, if x is an eigenvector of A corresponding to the eigenvalue A, then P~'x is an eigenvector of 
B corresponding to the eigenvalue A, where P is the similarity matrix. 
Proof Let A be an eigenvalue and x be the corresponding eigenvector of A. That is 
Ax = Ax. 
Premultiplying both sides by an invertible matrix P~', we obtain 
P Ax = AP “x. 
Set x = Py. We get 
P"APy=AP'Py, or (P''AP)y=Ay or By=Ay. 
where B = P-'AP. Therefore, B has the same eigenvalues as A, that is the characteristic equation of 
Bi is same as the characteristic equation of A. Now, A and B are similar matrices. Therefore, similar 


atrices have the same characteristic equation (and hence the same eigenvalues). Also x = Py, that 
is eigenvectors of A and B are related by x = >-Py or y=P™'x 


oF Theorem 3.10 states that if two matrices are similar, then they have the same characteristic 
tion and hence the same eigenvalues. However, the converse of this theorem is not true. 
Two matrices which have the same characteristic equation need not always be similar. 


() If Ai 7 similar to B and B is similar to C, then A is similar to C. ° 
jas chai be two invertible matrices P and Q such that 


A=P"'BP and B=Q™'CQ. 
A=P'Q'CQP=R'CR, where R= QP. 
‘Examine whether A is similar to B, where 


— oars . _ = 
‘ . a .- + j ; 
a Ts: 
= a y : 
| anc = 
I j na 
; os > gia 4 
4 
as! % 
ay 


wie - 
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bao le ill 


Solution The given matrices are similar ‘¢ there exists an invertible matrix P such that 


A=-P'BP or PA=BP. 
Let P= ° | We shall determine a, b, c, d such that PA = BP and then check whethe, 
S| 
P is non-singular. 
: a bli & <5 tb 21a — B:| Sa-2b Sa =| a+2c eal 
” : | 2 fe Ae d | 23 Sc— 2d de —~3at+4c —-3b+4d 


Equating the corresponding elements, we obtain the system of equations 


5a -—-2b=a+ 2c, or An — 2b —2e = 0 
5a = b + 2d, or —p—2a—0 
5c —2d = — 3a + 4c, or aa 4+ ¢— 24a = 0 


Sc = — 3b + 4d, or Babi Se— 4d = 0: 


A solution to this system of equations isa = 1,b=1,c=1,d=2. 


it 
Therefore, we get P = b | which is a non-singular matrix. Hence the matrices A and E 


are similar. 


7 iH Dit. ..0 jam 1G) 7: Sa a ob a+c b+d 
(il) = |, Or = 
em Om | 0). 1 lhe sued Coed) C NAD 
Equating the corresponding elements, we get 


a=at+c,b=b+d or c=d=0. 
ie GB ns 
Therefore, P = nb |, which is a singular matrix. 


Since an invertible matrix P does not exist, the matrices A and B are not similar. 


I 
t can be verified that the eigenvalues of A are 1, 1 whereas the eigenvalues of B are 0, 2. 
In practice, 
Pp fo a ee to obtain a non-singular matrix P which satisfies the equation A= 
iagonal matrix. Thus, our “ah B. However, it is possible to obtain the matrix P when A or B'S 
agonal interest is to find a similarity matrix P such that for a given matrix 4s 








D=P"'AP or PDP"'=A 


: S a diagonal matrix. If suc A : 7 
2 uch a matrix exists, then we say that the matrix A 1s 


Matrices and Figenvalue Problems 3.) . 


Diagonalizable matrices 


A matrix A is diagonalizable, if it is similar to a diagonal matrix, that is there exists an invertible 
matrix P such that P~'AP = D, where D is a diagonal matrix, Since, similar matrices have the same 
eigenvalues, the diagonal elements of D are the ei genvalues of A, A necessary and sufficient condition 
for the existence of P is given in the following theorem, 


independent eigenvectors. 


Proof We shall prove the case that if A has n linearly independent eigenvectors, then A is diagonalizable, 
Let X}, X, ..., X, ben linearly independent eigenvectors corresponding to the eigenvalues 
As, Any os « vAy (not necessarily distinct) of the matrix A in the same order, that is the eigenvector X, 
corresponds to the eigenvalue A, j = 1,2,...,n. Let 


P= [X), X2,...,X,] and D= diag (A;, Ay, ..., Ap) 
be the diagonal matrix with eigenvalues of A as its diagonal elements. The matrix P is called the 
modal matrix of A and D is called the spectral matrix of A. We have 
AP = A[x), Xa. «<s Xp] @ (AR, AM . «25 AX) 
= (A,X), AgXa, . .. , AnX,) = (Xj, Xo... X,)D = PD. (3.48) 


Since the columns of P are linearly independent, the rank of P is n and therefore the matrix P is 
invertible. Premultiplying both sides in Eq. (3.48) by P™', we obtain 


P'AP=P'PD=D (3.49) 
which implies that A is similar to D. Therefore, the matrix of eigenvectors P reduces a matrix A to its 
diagonal form. 

Postmultiplying both sides in Eq. (3.48) by P™', we obtain 
A = PDP“. (3.50) 
Remark 20 


(a) A square matrix A of order has always n linearly indendent eigenvectors when its ei genvalues 
are distinct. The matrix may also have n linearly independent eigenvectors even when some 
eigenvalues are repeated (see Example 3.42(iii)). Therefore, there is no restriction imposed on 
the eigenvalues of the matrix A in Theorem 3.11, 


(b) From Eq. (3.50), we obtain 
A? = AA = (PDP™"')(PDP™') = PD2P™'. 
Repeating the pre-multiplication (post-multiplication) m times, we get 
A” = PDP"! for any positive integer m. 


fore, if A is diagonalizable, so is A”, 






(c) If D is a diagonal matrix of order n, and 
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O(A,) 
Now, let a matrix A be diagonalizable. Then, we have 

A=PDP" and A”=PD"P™ 
for any positive integer m. Hence, we obtain 


Q(A) = PQ(D)P" 





for any matrix polynomial Q(A). 


Example 3.44 Show that the matrix 


3 1 -l 
A=|-2 1 2 
QO 3 2 


is diagonalizable. Hence, find P such that P~'AP is a diagonal matrix. Then, obtain the matrix 
B=A*+5A +31. 
Solution The characteristic equation of A is given by 
3-A ] —] 
ee ee Ae A 6A 1A — 60, of A= 1.2.3. 
0 I 2-A 


Since the matrix A has three distinct eigenvalues, 
hence it is diagonalizable. 
The eigenvector corresponding to the eigenvalue A 


it has three linearly independent eigenvectors and 


= | is the solution of the system 


2) 1 =) | x 0 1] 
(A -I)x=/-2 0 2 || x2 | =| 0 |. The solution is <= |—) | 
0 1 l X43 0 1 





1 | —1]| x, me 1 


(A -2I)x=/-2 -] 2 || x2 | =| 0 |. The solution is x = | 0 |. 


0 l 0 || x3 0 | ] 
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| = 3 is the solution of the system 











0 ; ! 
0} 0] 
(A —-3)z=[-2 —_» | “tl 
: . =O The solution is x; = / 1 | 
= | lol : 
ral : tii 
i 1 Q) it - = 
P= (e1,82."3) =) -1 0 lj and Pp ? ; at 
ion: Oy i-1 0 1} 
Itcan be verified that P~'AP = dias (1, 2, 3). 
We have D = diag (1, 2. 3), D* = diag (1, 4, 9). 
Therefore, A*+5A+31=P(D*?+5D+3nP™ 
6 oj] Is 6 of fa cae 6] [TS 8 O 
Now, D+5D+31=/0 4 O}]+/0 10 O}e/0 3 O}=/0 IF OO 
0 oo 9 0 oOo Bb] jo O 3] jo oO @ 
3 1 Of9 oOo OF-2- = 1 23 8 -8| 
B2s5A23%=-|-1 0 10 17 OF 2 1 -t]=|-18 9 18} 
ly 2 af O. WE). A.J 2. ho at 












E 
as 


Example 3.45 Examine whether the matrix A, where A is given by 


i _ ld oma 

fh 2 2 e 

0 a GPa =(°SE"t 6 
a 5 g *2g" gi 


wir - 


a * If so, obtain the matrix P such that PAP is a diagonal se 


acteristic equation of the matrix A is given by 


— eS i > 
; 2 2-A 





— : 
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—| 2 
(A — 21)x = QO Q 
=-1 2 


is 2, it has one linearly independent eigenvector. We 


nvector corresponding to the eigenvalue A= 1. Since 


s, the matrix is not diagonalizable. 


Since the rank of the coefficient matrix 
obtain another linearly independent eige co 
the matrix A has only two linearly independent eigenvector 


(ii) The characteristic equation of the matrix A is given by 


fh t-2 «3 
|A-AI|=| 2 1-4 -6|=0 or A +/?-21A-45 = 9, oF A=5,-—3,-3. 
—] -2 -A| 


Eigenvector corresponding to the eigenvalue A =5 is the solution of the system 


—7 2 —3 | X| 0 
2 —4 —6 xu |= 0 |: 
a 2? Sian! (0 


(A -S5IDx= 





A solution of this system is [1, 2, - he. 
Eigenvectors corresponding to A = — 3 are the solutions of the system 


Pa 23: Silex, 0 
(A +3Dx=| 2 4 -6})/x2/=|0] or x, + 2x,-3x;,=0. 
—| —2 3 X43 O 


The rank of the coefficient matrix is 1. Therefore, the system has two linearly independent 
solutions. We use the equation x, + 2x2 — 3x3 = 0 to find two linearly independent eigenvectors. 
Taking x3 = 0, x2 = 1, we obtain the eigenvector [—2, 1, 0]? and taking x2 = 0, x; = 1, we obtain 


the eigenvector [3, 0, 1]’. The given 3 x 3 matrix has three linearly independent eigenvectors. 


Therefore, the matrix A is diagonalizable. The modal matrix P is given by 


Pale ee edad PI4.2|-5 4°  ¢ 
i 8 
Wel a 


It can be verified that P~'AP = diag (5, — 3, — 3) 


Example 3.46 The eigenvectors of a 3 x 3 ma 
[1, 0, — 1]7, [0, 1,- 1]? and (1, 1, 0)" 


Solution We have 


: trix A corresponding to the eigenvalues 1, 1, 3 4 
respectively. Find the matrix A. 


and the spectral whe wi 
= hg) pectral matrix D = | 





oo =— © 
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Lies a 
We find that Pore =| — 
5 ] LE =f}. 
| ] l 
Oi = Ber 20 =) =! 
Therefore, A=Ppp('_1 0 1 Wie 4 1 -l 
5 | 
—-l -1l QO ;,0 OQ I l 
' I O 1] 1 --1 -1 2 
=a 0 AN isl i Sih ie aa) 
ot oi Ol 3 3 3 G JG 1.1 


- 


3.5.3 Special Matrices 


In this section we define some special matrices and study the properties of the eigenvalues and 
eigenvectors of these matrices. These matrices have applications in many areas. We first give some 
definitions. 
a | T : - 
Let X = (x), X2,...,X,) and y = (yj, y2,..., y,)’ be two vectors of dimension n in IR” or C”. 
Then we define the following: 


Inner Product (dot product) of vectors Let x and y be two vectors in IR”. Then 


K-y=x'y= 2 xy; (3.51) 


is called the inner product of the vectors x and y and is a scalar. The inner product is also denoted by 
<x, y >. In this case x * y = y ° x. Note that x- x 2 0 and x - x = O if and only if x = 0. 


If x and y are in C’, then the inner product of these vectors is defined as 


fi 
» Vix; 


t=] 


K+y=xX Y= 2xiy; and y -X=y'x= 


where X and y are complex conjugate vectors of x and y respectively. Note that x . y=y-x. Itcan 
be easily verified that 
(ax + By)*z=a(x*z) + Bly-z) 


for any vectors x, y, z and scalars a, B. 
Length (norm of a vector) Let x be a vector in IR” or C”. Then 


| x || =vx-+x= 


is called the length or the norm of the vector x. 





Unit vector The vector x is called a unit vector if ||x||=1. If x #0, then the vector x/ | x || is 
always a unit vector. 
Orthogonal vectors The vectors * and y for which x « y = 0 are said to be orthogonal vectors. 
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Orthonormal vectors The vectors of x and y for which 
x-y=0 and |[x||=1 lly l=! 


are called orthonormal vectors. If x, y are any vectors and x * y = 0, then x/|| x |, y/|| y | 


orthonormal. 
For example, the set of vectors 
Ly fO\ 0 
(i) |0|,| 1],| 0] form an orthonormal set in IR?. 
0 0) ] 
3i 0 35/5) (—4i/5) 0 
(ii) | —4i |, 0 | form an orthogonal set in C* and | —4i/5|,| 3/5], 0 
0 ee 0, 0) (i + i)//2 





form an orthonormal set in C2. 


Orthonormal and unitary system of vectors Let x), x3, .. . , X,, be m vectors in IR”. Then, th 
set of vectors forms an orthonormal system of vectors, if 


; 0, its 
Kj°Xj =X; Xj = ( : 
: [=]. 





Let X;, X>, . 


: . » 5 X,, be m vectors in C”. Then, this set of vectors forms an unitary system of vector 
i 


On fs J 
2x7 = | a 
ie ee 


i In section 3.2.2, we have defined symmetric, skew-symmetric, Hermitian and 
We now define a few more special matrices. 


Orthogonal matrices A real matrix A is orthogonal if A“ = AT. 


\ Ae pe Ge =sin “; 


skew-Hermitian matrices 
A simple example is 


sin @ cos @ 


= (A)! or (A)! = AT. If A is real, ther 
following. 


1. If A and B are Hermitian matri 
: matrices, then vr ¥ | 
since OA + PB is also Hermitian for any real scalars & B. 


Unitary matrices A complex matrix A is unitary if Aq 
unitary matrix is same as orthogonal matrix. We note the 
| 


(@A + BB)’ = (aA + BB)’ = GAT 4 BB" 
2. Eigenvalues and eigenvectors of A 
A, since 


= aA + BB. 


are the conjugates of the eigenvalues and eigenvectors 


Ax=Ax gives Ax = Ax. 
3. The inverse of a unitary (orthogonal 


) matrix is unitary (orthogonal). We have A-!= A’. L*! 


q 
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Bo'= A =(AT)1=((A) "= [(A)]? = BT. 


We now establish some important results. 


Theorem 3.12 An orthogonal set tors-istinearty independent. 


Proof Let X;, X2,..., X,, be an orthogonal set of vectors, that is x;° x; =0, 1 #/. Consider the vector 
equation 

X= QyX, + 2X, +... + An Xm=9 (3.52) 
where 0%, Q2,-..-, Q, are scalars. Taking the inner product of the vector x in Eq. (3.52) with x,, we 
get 


K° x, = (0X + Oko +... + Ok) ey — O° x — 0 







Or @(X,°x;)=0 or a || x, ||*=0. 

Since || x, ||* = 0, we get a, = 0. Similarly, taking the inner products of x with x2, X3,... 5 Xm 
successively, we find that a = @,=...=@,,= 0. Therefore, the set of orthogonal vectors X), Xz, . 
.. , Xm 1S linearly independent. 

Theorem 3.13 \ The eigenvalues of 


4t) an Hermitian matrix are real. 

(1) a skew-Hermitian matrix are zero or pure imaginary. 
(it) an unitary matrix are of magnitude 1. 

Proof Let A be an eigenvalue and x be the corresponding eigenvector of the matrix A. We have 

Ax = Ax. Premultiplying both sides by X’, we get 

x Ax 


XX 


x’Ax=Ax'x or A= (3.53) 





Note that x7Ax and x/x are scalars. Also, the denominator x/x is always real and positive. 
Therefore, the behaviour of A is governed by the scalar xX’ Ax. 


(i) Let A be an Hermitian matrix, that is A = A’. Now, 


(RTAX) = x7 AK = xTATE = (XAT)? = FTAX 
— J 


since x’ A’ x isascalar. Therefore, x’Ax is real. From Eq. (3.53), we conclude that A is real. 
(ii) Let A be a skew-Hermitian matrix, that is A’ = — A. Now, 
(%TAx) = x7 AX = —x"A'X = —(x7ATX)T = _XTAX 


since x’A’x is a scalar. Therefore, X'Ax is zero or pure imaginary. From Eq. (3.53), we 
conclude that A is zero or pure imaginary. 


(iii) Let A be an unitary matrix, that is A~'=(A)". Now, from 
Ax=Ax or AX=]1<X (3.54) 


(AX)7=(A%)" or ¥7AT = J XT, 
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or xTA = 1. (3.55) 


Using Eqs. (3.54) and (3.55), we can write 
(x7A-! (Ax) = (AX? (Ax) =[A|?x"x 


or x'x=|A|*x’x 


Since x 0, we have X7x # 0. Therefore, | A |* = 1, or A = + 1. Hence, the result. 


Remark 21 
From Theorem 3.13, we conclude that the eigenvalues of 


(i) a symmetric matrix are real. 
(ii) a skew-symmetric matrix are zero or pure imaginary. 
(iii) an orthogonal matrix are of magnitude | and are real or complex conjugate pairs. 


Theorem 3.14 The column vectors (and also row vectors) of an unitary matrix form an unitary 
system of vectors. 


Proof Let A be an unitary matrix of order n, with column vectors x,, X>,..., X,- Then 





— 7 “=—T =i Hin 
—7 | =—T =T 
Wad. eg Te, =.| 2 XX K7%2 
AT A=A‘A=|,* |[xi,X5,...,X%,]=].° 
T — — 
x EX) BoM 
¥ O, it*j 
Therefore, a xj; = : > Lie 
We = i= a. 


Hence, the column vectors of A form an unitary system. Since the inverse of an unitary matrix is also 
an unitary matrix and the columns of A“! are the conjugate of the rows of A, we conclude that the row 
vectors of A also form an unitary system. | 


Remark 22 


(a) From Theorem 3.14, we conclude that the column vectors (and also the row vectors) of 4” 
orthogonal matrix form an orthonormal system of vectors 


(b) Asymmetric matrix of order n has n linearly independent ei £envectors and hence is diagonalizable. 


Example 3.47 Show that the matrices A ‘i 
ile on A and A° have the same eigeny | a. wail les 
the eigenvectors corresponding to A and AT are mutually oar and for distinct eigen 


Solution We have 
|A-AI 1A" ATT |= (fA? any] =| a7— Ar 
pince A and A’ have the same characteristic equation, 
Let A and yp be two distinct eigenvalues of A. Let 


they have the same eigenvalues. 
X be the eigenvector corresponding ' the 
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eigenvalue A for A and y be the ej seaveets ie: | in 
Ax = Ax. Premultiplying by y”, we wet Or corresponding to the eigenvalue yz for A’. We hav 


yiAx=Ay"x. (3.5¢ 
| . re | a 
sepia A'Y=Hy, or (ATy)’=(uy)” or y7A= py’. 
Postmultiplying by x, we get 
y'Ax = py"x (3.57 


Subtracting Eqs. (3.56) and (3.57), we obtain 
(A— wy’x = 0. 
Since A # HW, we obtain y’x = 0. Therefore, the vectors x and y are mutually orthogonal. 


3.5.4 Quadratic Forms 


eG Re 2 ee =e be an arbitrary vector in IR”. A real quadratic form is an homogeneou 
expression of the form 
it fl 
O= 2 Ss Suir (3.98 
in which the total power in each term is 2. Expanding, we can write 


QO = ayx” + (ay2 + A291) XjXQ +--+ (Ayn + An X1Xy 
+ a22x 5 + (3 + €32)XoX3 +... + (Gay + Anz) XX, 


PE AE 77 ee 


= x' Ax (3.59) 
using the definition of matrix multiplication. Now, set 6; = (aj + a;)/2. The matrix B = (b;;) is 
symmetric since bj; = bji. Further, 5; + 5); = aj + a); Hence, Eq. (3.59) can be written as 


OQ =x' Bx 


where B is a symmetric matrix and bj = (aj + @j;)/2. 


For example, for n = 2, we have 
by, = dj), bi = b>, = (a2 sf @z,)/2 and b> = Ap). 


Example 3.48 Obtain the symmetric matrix B for the quadratic form 


@) Q = 2x? + 3x,;X2+ x3: 


; : ‘ : 
7 + : ) Q=x}+2x 1x2 — ax x4 + 6X2X3 5X5 4 4x3 
‘ = : 


‘ 
rr 
ra Tt af, = 
ee os 
1 @ 





@y, = 2, 42 + 421 = 3 and a>2 = 1. Therefore, 


r l 3 | 
. j by = 4 = eg bi2 = bai = 2 (a\2 ne a2 ) = F and boo =i0's3'= :, 
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2 3/2" 
Therefore, B= so : 
(11) ay, = lL, @j2 + 421 = 2, a\3 + 431 = — 4, a93 + 43, = 9, a2 5 33 


5 (ay3 + 431) = — 2 


hay. = = b- = 
b= a= 1 big ba = % (aia + 221) 1, 543 3] 


= — = 4, 
b3 = b32 = 5 (a23 + a2) = 3, dy = Aa, = — 9» 933 = 933 
l t =2 | 
Therefore, B= 1; Pees a 
—2 3 4 


If A is a complex matrix, then the quadratic form is defined as 
non x | 
Q= z 2X ay XiXj= x Ax (3.6] 
i=] j= 


where x = (x, X,.-., X,) is an arbitrary vector in C", However, this quadratic form is usually define 
for an Hermitian matrix A. Then, it is called a Hermitian form and is always real. 


| 
1-1 


a ee . ee ] l+i X| 
O'=x Ax= [x},%X2] eae D io 


= | x, [* + (1 + 1)X\X2 + (1 — 1)X 1X4 +2 X92 ie 


; ae . Ll+i | 
For example, consider the Hermitian matrix A = 4 } The quadratic form becomes 


= | x, |? 4 (X1X2+xX1X2) 1 i(X,X2 —X,X2) + 2 | x2 12 


Now, x)%2 + 1X2 is real and X;x2— x, is imaginary. For example if X = P; + ig, X2 = P2 + '92 
we obtain — 
HiX2 + 1X2 = 2(PiP2+ 9192) and X\xq—x)%2=2i(piq> — poq)): 


We can also write 
(X1 X72 +X 2X1) + i(X,xX2—X,X>) = 2[(P1 Pr am 4192) Bs (pPiq2 — p~q))] 


=2Re [C1 7 1)X,x>] 


Therefore, Q =| x, |’ +2Re[(1 + i)X,x.] + |x, 2. 


Positive definite matrices 


Let A = (a;;) be a square matrix. Then, the matrix A is said to be positive definite if 


ee Te = | x 
Q = x Ax > 0 for any vector x #0 and x’Ax = 0, if and only if x = 0. 
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If A is real, then x can be taken as real. 


Positive definite matrices have the following properties. 


1. The eigenvalues of a positive definite matrix are all real and positive. 
This is easily proved when A is a real matrix. From Eq. (3.53), we have 
A = (x"Ax)/(x"x) 


Since x'x > 0 and x7Ax > 0, we obtain A > 0. If A is Hermitian, then ¥7Ax is real and A is 


real (see Theorem 3.13). Therefore, if the Hermitian form Q > 0, then the eigenvalues are real 
and positive. 


2. All the leading minors of A are positive. 
Remark 23 


(a) If A is Hermitian and strictly diagonally dominant (| aj|> 2 |ajj|,i=1,2,...,2) 
. met jJ=1,/#I 
with positive real elements on the diagonal, then A is positive definite. 
(b) If x’Ax > 0, then the matrix A is called semi-positive definite. 


(c) A matrix A is called negative definite if (— A) is positive definite. All the eigenvalues of a 
negative definite matrix are real and negative. 


Example 3.49 Examine which of the following matrices are positive definite. 


ila 
oie Me ae (c) A fi P5 
= | = 5 Cc = : 
as of A i 
| = -I QO 
Solution 
7 3 il Xj 4 > 
(a) (i) =x AX = [xX),.%51] 2 pubes = 3x; + 3x)x2+ 4x5 
“ime 


gles 
= {x E 32) se Te? >0O forall x0. 
(ii) eigenvalues of A are 2 and 5 which are both positive. 


(iii) leading minors | 3 | = 3, ae | = 10 are both positive. 


Hence, the matrix A is positive definite (it is not necessary to show all the three parts). 


= ae 3 —2i X | ey 3x, — 2ix, 
(b) QO = x'Ax = [x),X2] oi 4 || x =t1,%2] ositm 


Bye — 21003 + Bix hy 4 4x52). 
Taking x, = p, + iq, and x2 = p2 + iq2 and simplifying, we get 
= 3(p? + 47) + 4(P5 + 93) + 4(p1 92 — p24) 
=p? + qj + 2p2 + 243 + 2 p2- G1)? + 2(p, + g2)2>0: 








4.84 Engineering Mathematics 


Therefore, the given matrix is positive definite. 
Note that A is Hermitian, strictly diagonally dominant (3 > | — 27 |, 4. >| 2i|) with positive re. 
diagonal entries. Therefore, A is positive definite (see Remark 23(a).) 


| 0 i Xy X1 + 1X3 
(c) Q=x'Ax =[X,,%2,%3]} O 1 O|/x2|=[%1,%2,%3]] = x2 
—I 0 3 x3 | —1X,+ 3x3 


= Ny Xy + 1X, X34 + X9X7 — 1X1 X3 + 323%; 
= | xy |? + |xo |? + 3 | x3 |? + iex3 =21%5) 
Taking x; = py + ig, X2 = p2 + ign, x3 = p3 + ig; and simplifying, we obtain 
QO = (pi + ai) + (p+ 93) + 3(p3+ 93) — 2(P193- P34) 
= (Pi— 493)” + (pa + 91)" + (P35 + 95) + 2(p3 + 93) > 0. 


Therefore, the matrix A is positive definite. It can be verified that the eigenvalues of 
are 1, 2, 2 which are all positive. 


Example 3.50 Let A be a real square matrix. Show that the matrix A7A has real and positi\ 
eigenvalues. 


Solution Since (A‘A)’ = A7A, the matrix A‘A is symmetric. Therefore, the eigenvalues of A’A ai 
all real. Now, 


x"A™Ax = (Ax)’(Ax) = y’y, where Ax = y. 


Since y’y > 0 for any vector y # 0, the matrix A7A is positive definite and hence al] the eigenvalue 
of A‘A are positive. Therefore, all the eigenvalues of A‘A are real and positive. 


Exercise 3.4 


Verify the Cayley-Hamilton theorem for the matrix A. Find A”, if it exists, where A is as given in Problems 
to 6. 


1 O —=-4 Si) gees | cis =2 ] 
Path Se 4: 7 Heal tay Sued eae ame MI 
—-4 4 3 Les 58 3 1 -l 
he 2 oee2 l l an L chideyt 
a 1 |. ~ 5 l 3 =] 1 Gy Tf zh, 
et Li <2 ihe, 4 | ae 


Find all the eigenvalues and the corresponding eigenvectors of th ven j to 18. Which 
of the matrices are diagonalizable? ‘© OF (he matrices given in Problems 7 to 
She = ae. 
ee ee | 0 |. oe Ts | 
gk a =e. 04 














i . = | « 
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Lad ial 
= 
—_ 
* 
— 
cS 
= 





gt i i # @| 
Diet Ge 2 =a =O it = 7 
ea 
| l ~ 
0 if 14. hingi 8 ‘|! Ce ae | 
| =| J] 2 i | st. 22 i 
Seid Il od nomeQ lL hee hie ui 
iteop 8 « 0-0) 0 05 3 Oo +f} 6-"e" "a 
+ Aha 4 0 "0" oF 1 6 i-th “rr oF a 
S.A sida Le 0 "O TG ol is (0 0 O80 4 OL 
a OO 10 "oO OG g "0 “so 8") 
LL 6 60 eo ree “6 ™ Oa 


Show that the matrices given in Problems 19 to 24 are diagonalizable. Find the matrix P such that P~'AP is a 
diagonal matrix. 


19, 


22. 


Ci) et =3) oot y 1 
@ 2 ol 20: || 2) “toma Sieh! ewan zt 
fenDp3 = Gras =3).0 0) 
eo: i Ss S6 6 ele de>) 
Soe At 23. =] ae a oy in det 
=) 37 So a (tS oa 


Find the matrix A whose eigenvalues and the corresponding eigenvectors are as given in Problems 25 to 30. 


25. 
26. 
27. 
28. 
29, 
30. 
= E 


32. 
33. 


35, 


, ~zAP, 
: a 
e x _ 


Eigenvalues: 2, 2, 4; Eigenvectors: (— 2, 1, 0)", (— 1, 0, 1)”, (1, 0, 1)”. 
Eigenvalues: 1, — 1, 2; Eigenvectors: (1, 1, 0)’, (1, 0, 1)”, (3, 1, 1)7. 
Eigenvalues: 1, 2, 3; Eigenvectors: (1, 2, 1)’, (2, 3, 4)", (1, 4, 9)". 
Eigenvalues: 1, 1, 1; Eigenvectors: (- 1, 1, 1)’, (1,-1, 1)”, (1, 1, - 1)", 
Eigenvalues: 0, — 1, 1; Eigenvectors: (— 1, 1, 0)", (1, 0, - 1)", (1, 1, 1). 
Eigenvalues: 0, 0, 3; Eigenvectors: (1, 2, - 1)", (— 2, 1, 0)", (3, 0, 1)7. 

Let a 4 x 4 matrix A have eigenvalues 1, — 1, 2, — 2. Find the value of the 
B=2A+A7!-I. 

Let a 3 x 3 matrix A have eigenvalues 1, 2, — 1. Find the trace of the matrix B = A — A~! + A2. 
Show that the matrices A and P~'AP have the same eigenvalues. 


Let A and B be square matrices of the same order. Then, show that AB and BA have the same eigenvalues 
but different eigenvectors. 

Show that the matrices A~'B and BA“ have the same eigenvalues but different eigenvectors. 

Ann Xn matrix A is nilpotent if for some positive integer k, A‘ = 0. Show that all the eigenvalues of a 
nil ootent matrix are zero. 

If A is an n x n diagonalizable matrix and A’ = A, then show that each eigenvalue of A is 0 or 1. 


determinant of the matrix 
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38. 


39. 
40. 
41. 


42. 
43. 


4S. 


47. 


49. 
30 
aL, 


52. 


53 


54, 


57. 
58. 
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‘ . | 
Ww = . + 1S fi dtoa diagonal matrix D = P ‘AP, where P ; 


a) 
cos @ see and tan 2@= 2h 


sin@ cos@ a-0 





of the form P= 


Let A be similar to B. Then show that (i) A-' is similar to B™', (ii) A™ 1S similar to B™ for any positiy. 


integer m, (iii) | A | =| B |. 

Let A and B be symmetric matrices of the same order. The 
AB = BA. 

For any square matrix A, show that A’A is symmetric. _ 
Let A be a non-singular matrix. Show that A’A™ is symmetric if an 
If A is a symmetric matrix and P-'AP = D, then show that P is an orthogonal matnx. 


n, show that AB is symmetric if and only jg 


d only if A? = (A’)’. 


. Show that the product of two orthogonal matrices of the same order is also an orthogonal matrix. 


ly my tO 

Find the conditions that a matrix A=|/, m2 nz | is orthogonal. 
I; m3 ny 

If A is an orthogonal matrix, show that | A |= 1. 


Prove that the eigenvectors of a symmetric matrix corresponding to distinct eigenvalues are orthogonal. 


. A matrix A is called a normal matrix if AA’ = A’ A. Show that the Hermitian, skew-Hermitian and 


unitary matrices are normal. 
If a matrix A can be diagonalized using an orthogonal matrix then show that A is Symmetric. 
Suppose that a matrix A is both unitary and Hermitian. Then, show that A = A7!. 


If A is a symmetric matrix and x7Ax > 0 for eve 


3 ry real vector x # 0, then show that Zz’ Az | — 
positive for any complex vector z + 0. , Ow that z* Az is real and 


Show that an unitary transformation y = Ax 
= ’ wh tr ‘ 
product. ere A is an unitary matrix preserves the value of the inner 


Prove that a real 2 x 2 symmetric matrix thee iti ite j 
b | 18 Positive definite if and only ifa>0(1 x | leading 
minor) and ac — b? > 0 (2x2 leading minor), 
2s al 3. 
Show that the matrix |~3 4 —1| is positive definite. 
|-l |] 2 | 
io) ama | 
Show that the matrix | —2 


0 4] is not POsitive definite. 
=—G \ S93 as 


By — 2x 1X2 + Axyxs — x2 + x2 
, 2 | 


ae Si 
x, + 2ix\x» = Bx x; T 4ix>x, + 4x? 


§Y, 


ol), 
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: ’ 4 | + 
vy = + AON = (4 = Daa, 4 x2 


ve . Ave. i‘ 
‘x ty 7 (QO s : 


3.6 Answers and Hints 


Exercise 3.1 


a 


10. 
13. 


14. 
15. 
16. 
17. 
21. 





: | | 
ey . 2 -3 4 5) 
A™ = 5 =3 2 |. 4. A-! = aN 9 —| —4 
| 2 =«3 2 | 
| o | > ee ts eee 
(i) | A aaj (A) | = diag ( |A|,| A avait’ | A|)=|A_|" (use property 10 of determinants). Therefore, 


| Adj (A) | =| A |""! 
(i) Let B = adj (A). Since B! = adj (B)/| B |, we have B adj (B) =| B | I. Therefore, 
adj (A) adj (adj (A)) = | adj (A) [[=| A |". 
Premultiplying by A and using adj (A) = A™'| A |, we get 
A[A™| A | ] adj (adj (A)) =| AJ""' AI or adj (adj (A)) =| A |""? A. 


|AA*|=|A [| A] =|] or] At] =1// A]. 


(BAB’)’ = BA’B? = BAB’. 
AB=BA > B'AB=A => B"'A = AB“! Similarly, A“B = BA“. 
(i) (AB“)’ = (B"')‘Al = (B’)'A! = BA = AB". 

Gi) (AB)? = B7(A7!)! = BA")! = BAT = AB. 

(ii) (A“B™)? = [((BA)"']" = [(ABy']" = (A7)""(B"y" = AB. 
Premultiply both sides by (i) I-A, (i1) I+ A. 
(PAQ)! = QAP! =I A'P'=Q> A" =QP. 
Use (I-A)I+A+A’7+...J =I 
(ABC)(ABC)" = I. Premultiply successively by A”, B! and C"!. 
Multiply C; by a, C2 by b, C3 by c and take out a from R,, 6 from R», c from R3. 


sina@ cosa O]|| cosa cosb sine 


snB cosB O sina sinb  sinc|=0 

lsiny cosy 0 0 0 0 
| ap as = am, 1, 23 1: 30, 1, 1,2. 
ee he @ 32. (i) k #2 andk 4-3, (i) k=2, ork =-3. 


33. @=7/6, or O=sin '[9- J161)/4]. 
35. (i) A¥3, p arbitrary, (ii) A = 3, # = 10, (iii) A= 3, w# 10. 
36. 2 ‘i hm 6 38. 2. 


Dm [Al=0- 94-00 ich a ts TAPS AS 


bs 


? o 
at 


— (i) 3, ifpeqerandp+q+r#0; 


ASS 


40. 


43, 


45. 
46. 





52. 
55. 


. Conder (1 + AU A + At... 


49. 
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(ii) Vifpegetrandp+g+tr=0, 
(iii) 2, if exactly two of p, ¢g and Fr are identical; 
(iv) lLip=q@qe=er 
(a) 2: (b) | Al = (ayaa + yb) + Cyeg)*, rank (A) is 
(i) 4, if ajay + Bpdy + eye #0; 
(ii) 2, if ajay + Bybs + Eye) = 0, since all determinants of third order have the value zero. 
+(— 1 'A™) = 14 (- 1)"A". In the limit 2 > oe, A" > 0. Therefore. 


(i+ A= A + At. Jen 


" Ha 
(i) Trace (@A + BB) = @ ~ a, + B ~ b,, = @ Trace (A) + B Trace(B), 


(ii) Trace (AB) = oy * a,b; = 2 z bi »Qmi = Trace (BA), 


(iit) If the result is true, then Trace (AB — BA) = Trace (I) which gives 0 = n which is not possible. 
Result is true for p= 0 and 1, Let it be true for p = & and show that it is true for p= k + 1. Note that when 
BC = CB and C* = 0, we have CB**! = B*'C and CB‘C = 0. 

Apply the operation C) — C; + C) +... + C, and then the operation R; <— R; — iS) GP aS Se 


None. 47. Symmetric. 48. Skew-symmetric. 
Hermitian. 50. None 31. Skew-Hermitian. 
None. 53. Skew-Hermitian. 54. Hermitian, 
None. 


Exercise 3.2 


1. 


12. 







Yes. 2. No, 1, 4, 5, 6. ae No, L, 4.5: 6. 


No, when the scalar is irrational, property 6 is not satisfied. If the field of scalars is taken only as 
rationals, then it defines a vector space. . 


Yes, since 1+x=lx=x=x | =x] =x=x. the ze 
xX + (— x) = x(I/x) : | a = hats ee . ciehae : — 
_ No, 8, 10. FINO. 3,-8.0. 
Yes (same arguments as in Problem 5.), (@ + B) x= xFFP = ~% 8. po, 8 ax + Bx. 
(i) Yes, (ii) No, 1, 6. 
(i) Yes, (li) No, 1, 4, 6. 
(i) Yes, (ii) No, whenx, ye Wx 4 ye W. 


(iii) No, whenx,ye Wex+ye@W, (iv) Yes. 

(i) No, when Ae W, @A € W for @ negative, 

(ii) No, sum of two non-singular matrices need not be non-singular 
(iii) Yes, 





(iv) No, @A and A +B need not belong to W, (A =I, A27=I=A but 2A # (2A)?). 


a . : (li) No; let @ =i. Then QA=iA€ W. 
» (i) No;forP,QEW.P+QeW, (ii) Yes 
A 


15. 


16. 


17. 


18. 
19, 


20. 


21. 


22. 


25. 


27. 


28. 
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(ili) No; for P, @€ W, aP @ Wand also P + Q¢ W, 


(iv) No, for P, Q € W having real roots, P + O need not have real roots. For example, take 
P=27-1,0=-°43 


(i) Yes, 


(i) No, x,y € W,x+y¢ W. For example, if x = (x, x, x — 1), Y= On. Yr Yi — “YS 
X+y=(x, + V1 X1+ yi, x, + y, -2) € W. 
(iii) No,x€ W, @x¢€ W, fora negative, 
(iv) No,x€ W,ax¢ wW, (v) No, xe W, ax € W, (for aa rational number). 
(i) u+ 2v-w, (ii) 2u+v-w, 
(iii) (— 33 uu — ll v + 23 w)/16. 
(i) u-—2v + 2w, (ii) 3u+v-w, (iii) not possible. 
(i) 3P,(t) — 2P,(t) — P,(2), (ii) 4P,(t) — P2(t) + 3P3(t). 
Let S = {u, v, w}. Then, x = (a, b,c)’ = au+ By + yw, where a@ = (a + b)/2, B= (a — b)/2 and y=c. 


| | a b) 
Let S = {A, B, C, D}. Then, E = * 4 = aA+ BB+ yC + dD, where a= (—a — 6 + 2c — 2d)/3, 
c 


B= (Sa + 2b — 4c + 4d)/3, y= (- 4a - b + 5c — 2d)/3 and 8= (-2a+ b+ c—-d)/3. 


(i) independent, (ii) dependent, (i11) dependent, 
(iv) independent, (v) dependent. 

(i) independent, (i1) dependent, (ii) dependent, 
(iv) independent, (v) independent. 


(— 4, 7, 9) = (1, 2, 3) + 2-1, 3, 4) — (G3, 1, 2). The vectors in S are linearly dependent. 
P+t+1=([-1+ (" -1) + 2¢7 + 2 + 2)]/3. The elements in S are linearly independent. 
(i) dimension: 2, a basis : {(1, 0, 0, — 1), (0, 1, — 1, 0)}, 
(ii) dimension: 3, a basis: {(1, 0, 0, 1), (0, 1, 0, 1), (0, 0, 1, 1)}, 
(iii) dimension: 3, a basis: {(1, 0, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)}, 
(iv) dimension: 1, a basis: {(1, 1, 1, 1)}. 
The given vectors must be linearly independent. 
(i) k#0, 1, - 4/3, (iil) k #0, (ili) k #0, (iv) k¥-8. ° 
(i) dimension: 4, basis: {E,,, Ey2, E2;, E22} where E,, is the standard basis of order 2, 


i NOV 60) 1) fo 6 
(ii) dimension: 3, basis: + 6 olla “Org: Salt 


0 1 
(iii) dimension: 1, basis: (_ | 


(iv) a2 x 2 skew-Hermitian matrix (diagonal elements are 0 or pure imaginary) is given by 


id, b, RLS ib, | - 0 b, | ay bs 
a= —b, + ibz lay | —b, 0 + b, a> =B+iC 


where B is a skew-symmetric and C is a symmetric matrix, 


3.90 


29. 


30. 
31. 
a2. 
33. 
34. 
35, 
36. 


37. 
38. 


= && 


42. 


43. 
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dimension: 4, basis: 


ff =1) (0 -0\ (0 0 
0 lh dhe if 
(i) dimension: 3, basis: {E,,, E22, E33}, 
(ii) dimension: 6, basis: {E,,, Ey2, E13, E22, Ex, E33}, 
(iii) dimension: 6, basis: {E,,, E21, E22, E3;, E32, E33}. 
where E,, is the standard basis of order 3. 
(i) n’, (ii) xn, (iii) n(n + 1/2, (iv) n(n —1)/2. 


(vi) dimension: 3, basis: 


(vy) dimension: 3, basis: | 


Not linear, 7(x) + T(y) # T(x + y). 
Linear. 
Not linear, 7 (x) + T(y) # T(x + y). 
Not linear, 7(1,0))}=3, 7(0; 1)= 2, TU.1) =0 4 7(1,.0) + TO, 1). 
Not linear, 7(x) + T(y) # T(x + y). 
ker(T) = (0;0,0)!,.ran (F)= x(1, 0;,1)' + y, 0, = 1)7 +:<(0, 1, 0)¢. 
dim (ker (T)) = 0, dim (ran (T)) = 3. 
ker (T) = (0, 0)’, ran (T) = x(2, - 1, 3)’ + y(1, 1, 4)". dim (ker (T)) = 0, dim (ran (T)) =2. 
ker (D).= we — 2,0; 1%. 
ran (T) = x(1, 0, 0)" + y(1, 0, 1)? + 2(0, 1, 0)7 + w(1, 0, 2)7 
= r(1, 0, 0)’ + s(1, 0, 1)" + 2(0, 1, 0), 
where r=x-—w,s=y + 2w. dim (ker (T)) = 1, dim (ran (T)) = 3. 


. ker (T) = x(—3, 1)’, ran (7) = real number. dim (ker (T)) = 1, dim (ran (T)) =1 
. ker (T) = x(1, — 3, 0)’ + z(0, 0, 1)", ran (7) = real number. 
- ker (T)=x(1, Ly", ran (T) = x(1, Neal 1)’ = r(1, i 


dim (ker (T)) = 2, dim (ran (T)) = 1. 


. where r= x — y. 
dim (ker (T)) = 1, dim (ran Cea kk 


-er(T) = DaanT £ | 
“ (T) x(1, A 3) ’ — (T) = x(2, a)" +. y(- is QO)? + z(0, LF Or ran (T) — n= ] 0)? + 5(0, 1)/, where 
r= y+ 2x, 5= z+ 3x. dim (ker (T)) = 1, dim (ran (T)) = 2. sli 


: L 1 
ala oa: 
. , at (ii) a-| get an 
ne | 


0 


-_ 
SS 
> 
ll 
NM bb 
a 
— 
—, 
bh 


a =e 172" 
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—1/2 m2 3/9 mit 

45. A =| =1/2 — 3/2 —1/2 |. ‘ 
0 —] —] ) 

0 0 





—| l 1 i ee 4 
47. We have Tlvi, V2] =([w,,w2, w,]A = a1 Pie Sh | 2 Fp 
4 0 


I a 


tad 


Now, a =i T . ; . . 
OW, any vector X = (x, x2)" in IR? with respect to the given basis can be written as 


Pletal ols] 


We obtain a = (— 4x, + 3x,)/2, B= (2x; — x)/2. Hence, we have 


4 5] [4a+5f —6x, + 7x» | 
Tx=aTv, +BTv, =a|\2|+B)3|= 2a+3B| => —2x,+3x, 
0 1 B 2X) —X4 
—xX,;+2x,+ 8x 
48. Tx = | 
—2x; + 3x2 + 12x; | 


49. T Py(t) = (4x2 — 5xy) + 7 (x2 — xy) £ + (2x, — x2) &*. 


50. (i) Two degrees of freedom, dimension is 2, a basis is {[3, 1, 0], [- 2, 0, 1]}. 
(ii) One degree of freedom, dimension is I, a basis is {(— 5, 4, 23)}. 


Exercise 3.3 


| Ome 2. 2 3. 3. 4. 2. 

aay, 6. 2. 7. 2. 3 

9. 4. 10. 2 ll. 2. 1243. 
19. 3) 14. 2. 15. 2: 
16. Independent, 3. 17. Independent, 3. 18. Dependent, 3. 
19. Independent, 3. 20. Dependent, 2. 21. Dependent, 3. 
22. Dependent, 2. 23. Dependent, 2. 24. Independent, 4. 


25. Dependent, 2. 26. [1, 2, 2]. 
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27. [1 + a —2«a, a], @ arbitrary. 28. Inconsistent. 

an Th th a0, (1. 33.3); S31. [8/2, 3/2; 1. 32. [-— 1, — 1/2, 3/4) 
33. [(5 + a-4B)/3, (1 + 2a+ B)/3, a, B], a, B arbitrary. 

34. [2-a, 1, &, 1], @ arbitrary. 35. [— 1/4, 1/4, 1/4, 1/4]. 

36. [— & q, a], @ arbitrary. 37. [- 15a, 13a, a], & arbitrary. 

38. [0, 0, 0}. 39. [— 2a/3, 7a/3, — 8a/3, a], & arbitrary. 

40. [2(68 — o)/3, — (58 + a)/3, B, a], a, B arbitrary. 

41. [0, 0, 0, 0}. 42. [(2B-5a)/4, — (108 + a)/4, B, a], a, B arbitrary. 


43. [(a@ + 5f)/3, (4B - 7a)/3, B, ai], o, B arbitrary. 
44. [38 — 50/3, (38 - 4a)/3, B, a], a, B arbitrary. 
45. [a-38, 5B, B, al, a, B arbitrary. 








1 l —| ] | 
A It aad ai. a2 ‘4 5), alt i -1 (| 
ie 2 1 [a 2 (3) ds 1 
i ah = fiat <18 1 1 
49 1 | 9 l 0 cn l 0 QO —-] 
2 i i TO = ll call 1 0° 0 
cd @ i Sie 18 “6 
Exercise 3.4 
i - 16 =90 
1. P(A) = 13 -9A?~92 + 81 =0: Att 1G 13 al. 
= V=o Mg aes 
6 <4 23 
2. P(A) = A} - 8A? + 202 - 16 = 0: A“t= 4 Gill eRe «os| 
—2 =4 6 
3. P(A) = A? — 3A? + 2A = 0; Inverse does not exist. 
oh a 
4. P(A) =A -2?-444+4=0: Aled ee 
<2 1 
2 gy 
§. P(A) =A? - 52? + 94 - 13 = 0: Ants 4 Li S Sener 
ee eee, 


6. P(A) =A? - 3A + 6A-44+ 21 =0: Ant=— 143i 


‘ald 
La) 
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PA EAA YA = 2, 25:2, 1 0)%) ne diagonalizable. 

(ey, ae ae ae 
8 A=-1:0,-1L D5 ASE 4; l, 1)"; A=—i: (1-3, 1, 1, diagonalizable. 
9. A=1, 1, 1: [0,.3, —2]7: not diagonalizable. 


= —1}'; A=7: : 
10. A=1, 1: (0, 1,- 1]; A =7. (6, 7, 5)’; not diagonalizable. 


ph 0, Wy A= t € 3: (1, 45. fy 
A=1- 3: [l, -(/3 + 1), -i]"; diagonalizable. 


a= obi th ©, — 1", (f.— 1. 0)’; A = 2i: [1, 1, 1]"; diagonalizable. 
13. A=0, 0, 0, 0: [1, 0, 0, OJ7: not diagonalizable. 


14. A=0, 0: [1, 0, 0, 1]7, (1, - 1,~1, 0)’; A=2: [1, 1, 0, oj”: 


|’ 


1 


=— 2: [1, 0, 1, 1]"; diagonalizable. 

15. 4=— 1,-1,~1: [1,-1, 0, 0), [1, 0, -1, of", (1, 0,0,- 1)"; 
A = 3: [1, 1, 1, 1]; diagonalizable. 

iG 4——4- (1,1, - 1,= 1)"; A = 10: (1, 1,1, 17 A= V2: (2-1, 1- 42.-L A, 

A= —V2:[-(1 + 42), 1+ 42, -1, 1]; diagonalizable. 

17, A=—1,-1:[1, 0, 0, 0, - 1]7, (0, 1,0,-1, 0J7; A=1, 1, 1:[1,0,0,0, 1}’, (0, 1, 0, 1, OJ", [0, 0, 1, 0, 0)”: 
diagonalizable. 

18. A= 1, w, w’, w°, w*, w is fifth root of unity. Let €;= w’, 7 =0, 1,2,3,4.4= cf (1. &;, Es e Esl = 
j = 0, 1, 2, 3, 4; diagonalizable. 

19. A=2, 2: [1, 0, — 1)’, [—-2, 1, 0]; A=4: [1, 0, 17. 










es I fo 
=| 0? GErt=2}0 2 “ot 
=e “fF ie eae || 
20. A=1:[1,—2, 0)’; A=—- 1: [3, —2, 2]; A=2: --1, 3, 1)”. 
i 3 
eo =2 
0 2 
2 A=6 B, .— 21: A=2i: (3 +i, 1 + 3i,-4)';A=-2:: Bai 1-37 — 47" 
és 3+1 —8 16 
P=/1 1+3i 3367 AS 
2S : i-6 2+6: -8] 
22. A=0-[1,0,- 1 4=1:(- 1,-1.1 4=2 011, oF 
” == Tees 1 =], 0 
, meen (Ee H|t. =i) 
2 hei eae Th 3 kl 
Sided id, 3)"; A=2,2:(2, 0,17. 2.1, oF. 
a ae: = he Dalal 
, > : | Peo i¢r*=| > =  =5 
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vat 
M4. A=1:(1,-1,-175 A=2: (0, 1,17, 42-2: (8-5, 7: 


) ekg IZ BB 
r-|- 1 -5hP=—/12 15 ~-3} 


i ee eee Ole: teh hignt 








=) «alm J CG me 3 : 
| apet 2.2 lady 3 1|;A = PDP-' =| 0 
P=) 1 0 OP tas ts 
oO” fe i .a 1 
im tf 3 212 1 alae: 
MH P=11 0 IFPSl-1 1) 2) A= PDP = Gi) 
@ 1-4 1 -1 -! en mA 
? 2. 4 =i 14 5) | mh “12 «(G 
27. P=|2 3 4;bP4=2 | 14 -8 25A=PDP=--| 2 4 14 
9 1 a oe u34 - 4) 38 
pa: 2 21 i or <0 
mea 2 ey pte 19) oA ppp "2 0 ||) a ol 
a ed 1s 16 0 oO 1 
a 4 =| 2 4 i On 3 
 P=| 1 0 bP t= 4 1-4 -2|,A = PDP"! = 4 aes 
Post 1 ei, oi a 5: Ss Salis 
28. 3 Peay = 3 9 18 45 
30. P=/| 2 ] 0; P= 2 =) at 6); A = PDP-! = 2 0 0 0 | 
iii 1 ie? 5 oe fs 


31. Eigenvalues of B are 2A, + (1/A;) - 1, j = 1, 2, 3, 4 or 2, — 4, 7/2, — 11/2. | B | = product of eigenvalues 


of B = 154. 


32. Eigenvalues of B are A, + A‘ _ (1/A)), J = 1, 2,3 \.0r' 1, 11/2, 1. Trace of B = 
B= 15/2. 

33. Premultiply Ax = Ax by P~! and substitute x = Py. 

34. Let A be an eigenvalue and x be the corres 
A“ and substitute x = Ay. We get BAy = J 
are related by x = Ay. 

35. Let A be an eigenvalue and x be the corres 
by A and set x = A-!y. We obtain BA" 
corresponding eigenvector ¥= As. 

36. From Ax = Ax, we obtain A*x = Jk 


x= 0. Therefore, 74 
37. Since A is a diagonalizable matrix. 


= 0orA=0, since x + 0. 


sum of eigenvalues of 


ponding eigenvector of AB, that is ABx = (x. Premultiply by 
y. Therefore, A is also an eigenvalue of BA and ¢i genveclor 5 


ponding eigenvector of A~'B, that is A~'Bx = Ax. Premultip? 
y = Ay. Therefore, A is also an eigenvalue of BA” with! 


: » there exists a non-singular matri ‘, = DP and 
: a = L J tr | ‘ i { d alt 
peggy of A and pD are same. We have a 2p _ ix P such that r . ve $0! 
PAP = D’. Therefore, we obtain D2 . = D*. Since A?’ = A, 


or 1. Thus D () 


oD=I. Hence, the eigenvalues of A as 





38. 
39. 


40). 


41. 
42. 


43. 
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Simplify the right hand Side and set the off- 
Since A and B are Similar 
A = P'B- Pp and A” | 


diagonal element to zero. 


we have A = P'BP. From this equation, show that 
= P'B P. Also| A|=|P™'||B||P]=|B]. 


An 7 
We have A = A‘ and B = BT Therefore, (AB)’ = B’A? = BA. 
(ATA)? = ATA. | 
: Ta-l 3 
a A a be a symmetric matrix. We have (A7A™')? = (A“)7A = ATA) or (A7)TA2 = AT or 
A= = (A ae Now, let A? = (Al)? We have AA = ATAT =s A =-A'AZA!T = A(A? Il = Waa. or 


ACA)! = CA=LA RT = 
(AM) = (ATA = Ata - Therefore, A7A™! is symmetric. 


Since A is symmetric, we have 


[= =I =A ATL = | | 
AVA =A7!AT (PDP™!) PDP")! = (PD'P"') [((P~')"DP"], since D? = D. This result is true only 
when P-'(P')’ = I, or P-! = p?. 


44, ee and B be the orthogonal matrices, that is A~! = A? and B-! = B7. Then (AB) =B7A"=B A = 

45. A = AT gives AA’ = I. We obtain the conditions as if tm tn; =), % = 1, 2, 3 and 
lily + mymz + nn, = 0, LiL, + mym; + nn; = 0, Il; + MyM; + Aon; = 0. 

46. Since A is an orthogonal matrix, we have A“! = A’. Hence, | A} |=|A?|=|A|or1/| A |= 
|A|=>|A|?=1or|A]=1. 

47. Let A and p be two distinct eigenvalues and x, y be the corresponding eigenvectors. We have Ax = Ax 


49, 


51. 


52. 


53. 


54. 


55. 


and Ay = jy. From the first equation, we get x’A’ = Ax! or x’A =A x". Postmultiplying by y, we obtain 
x’ Ay = Ax’y. From the second equation, we get x’Ay = px’y. Subtracting the two results, we obtain 
(A — p)x'y = 0, which gives x’y = 0 since A ¥ LL. 


There exists an orthogonal matrix P such that P-'AP = D. Now, A = PDP™! = PDP’, since P is 
orthogonal. We have Al= (PDP’)’ = PD’P’ = PDP’ =A, sincea diagonal matrix is always symmetric. 


Let z= U+iV, where U #0, V #0 be real vectors. Then 

Zz! Az = (U"AU + V7AV) + i(U7AV — V7AU) = UZAU + V7AV > 0 
since UTAV = (UAV)! = V’A'U = V’AU. 
Let the vectors a, b be transformed to vectors u, v respectively. Then 
(u,v)=u'yv =?:v=(Aa)’ (Ab) =a'A’Ab=a"b=a-b. 
xTAx= Lev nl al fea Sis) ee 


= al(x, + bx,/a)” + x} (ac - b*)/a*] > 0 for all x, xp. 


Therefore, a > 0, ac - b* > 0. 
2 l 3x l 


x’ Ax =[x,,%2>%3] a3). 4. =h*e 
Si | ] 2 X43 | 


= 2x? —2x,xX2 + 2%1%3 + 4x5 + 2x3 = (2X; —X2)° + (4, + 43 )° + 3xz + x7 > 02 


All the leading minors are not positive. If can also be verified that all the eigenvalues are not positive. 


mt 


1 
1+ 2i 
0 


=} =9} 
| 
-2<H 


0) 
=243i i 
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Chapter 3 
Matrices and Eigenvalue Problems 





3.1 Introduction 


In modern mathematics, matrix theory occupies an important place and has applications in almost all 
branches of engineering and physical sciences. Matrices of order m x n form a vector space and they 
define linear transformations which map vector spaces consisting of vectors in IR” or C” into another 
vector space consisting of vector in IR” or C” under a given set of rules of vector addition and scalar 
multiplication. A matrix does not denote a number and no value can be assigned to it. The usual rules 
of arithmetic operations do not hold for matrices. The rules defining the operations on matrices are 
usually called its algebra. In this chapter we shall discuss the matrix algebra and its use in solving linear 
system of algebraic equation Ax = b and solving the eigenvalue problem Ax = Ax. 


3.2 Matrices 


An m X n matrix is an arrangement of mn objects (not necessarily distinct) in m rows and nm columns 
in the form | 


4, A ** Ap 
| ad a 

A= — 22 7 ay, (3.1) 
Any Gm2 "* Sn | 


We say that the matrix is of order m xn (m by n). The objects a), 4,7, ..-,4m, are called the elements 
of the matrix. Each element of the matrix can be a real or complex number or a function of one more 
Variables or any other object. The element a, which is common to the ith row and the jth column is 
Called its general element. The matrices are usually denoted by boldface uppercase letters A, B, C.... 
etc. When the order of the matrix is understood, we can simply write A = (a;;). If all the element of a 
matrix are real, it is called a real matrix, whereas if one or more elements of a matrix are complex it 
8 called a complex matrix. We define the following type of matrices. 
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3.2. Engineering Mathematics 
ne row and 77 columns is called q ,, 

Wy 

"ct, 


: at is, it has 0 
Row Vector A matrix of order | * 7 that is, 
written 45 


or a row matrix of order 7 and 1s 
~» Of 
(ay, 412 °°" Ayn), OF [ay 42 - al 
in which aj, (or a;) is the jth element. 
| . any m TOV d one column i 
Column vector A matrix of order m X I, that is, it has 7 rows mn ts called g Co| 
, | | d is written 4s Hn 
vector or a column matrix of order mi an 
bij by 
b, . b, 
“" | or ; 
Din Dm 
in which b,, (or B,) is the jth element. | 
as a ‘< called i Jer. The vectors 
The number of elements in a row/column vector IS C4 led its order. are usually denote 
__ etc. If a vector has 72 elements and all its elements are jey 


by boldface lower case letters a, b, ¢, - 
=. 8 ‘ i 
numbers, then it is called an ordered n-tuple in IR’, whereas 


* ' il 
numbers, then it is called an ordered n-tuple.in C. 
of order m Xn, m#n 
which m = 2”, that is number of rows is equal tp 


if one or more elements are comple, 


Rectangular matrix <A matrix A iS called a rectangular matrix. 


Square matrices A matrix A of order m xX in 
the number of columns Is called a square matrix of order n. The elements @jjy. that is the elements 
Ayy> Ao95 +++ Ann AE called the diagonal elements and the line on which these elements lie is called 
the principal diagonal or the main diagonal of the matrix. The elements a,, when i #/ are calle 
the off-diagonal elements. The sum of the diagonal elements of a square matrix is called the trace 


of the matrix. 


Null matrix A matrix A of order m x 7 in which all the elements are zero is called a ull mar 


or a zero matrix and is denoted by 0. 


x A square matrix A in which all the off-diagonal elements ay, FL zero | 


Diagonal matri 
called a diagonal matrix. For example 


A= te is a diagonal matrix of order I. 


0 ain 


A diagonal matrix is denoted by D. It is also written as diag [a,) @o) --- Qml- 

If all the elements of a diagonal matrix of order n are equal, that is a, = & for all /, 
‘s called a scalar matrix of order n. = 

If all the elements of a diagonal matrix of order m are 1, then the matrix 


iX 
then the malt 





cee di 
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> 
I 


1s called an unit matrix or an identity matrix of order n. 


An identity matrix is denoted by I. 


Equal matrices Two matrices A = (4i))mxn and B = (b,),,, are said to be equal, when 


(i) they are of the same order, that is m = P,n =q and 
(ii) their corresponding elements are equal, that is a, = b, for all i, j. 


Submatrix A matrix obtained by omitting some rows and or columns from a given matrix A is 
called a submartix of A. As a convention, the given matrix A is also taken as the submatrix of A. 


3.2.1 Matrix Algebra 
The basic operations allowed on matrices are 


(i) multiplication of a matrix by a scalar, 
(ii) addition/subtraction of two matrices, 
(iii) multiplication of two matrices. 


Note that there is no concept of dividing a matrix by a matrix. Therefore, the operation A/B where 
A and B are matrices is not defined. 


Multiplication of a matrix by a scalar 
Let a be a scalar (real or complex) and A = (a,,) be a given matrix of order m x n. Then 
B= aA = Qa;) = (Qa;,;) for all 7 and /. (3.2) 
The order of the new matrix B is same as that of the matrix A. 
Addition/subtraction of two matrices 
Let A = (a,) and B = (b,) be two matrices of the same order. Then 


C=(¢,) =ats= (a;,) + (b;) = (a; + bi), for all i and / (3.3a) 
and D = (d;) = A- B = (a;) - (b;) = (ay — 5y), for all i and j. (3.3b) 
The order of the new matrix C or D is the same as that of the matrices A and B. Matrices of the same 
order are said to be conformable for addition/subtraction. 
IPA), Aa, ..., A,, are p matrices which are conformable for addition and @, 0, ..., &, are any scalars, 
then | 

C= a,A, + @,A,+... + aA, (3.4) 


is called a linear combination of the matrices Aj, Ao, .... Ap. The order of the matrix C is same as 
that FA P= TB. cesy D 
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3.4 Engineering Mathematics 


Properties of the matrix addition and scalar multiplication 


Let A, B, C be the matrices which are conformable for addition and a, B be SCalars Then 


1 A+B=B+A. (commutative law) 


(A +B)+C=A+(BtC) (associative law). 
-At+O=A (0 is the null matrix of the same order as 4), 


2 
3 
4. A+(-A)=0. 5. a(A + B) = aA + aB 
6. (a + B)A = aA+ BA. 7. a (BA) = aBA. 
8. 1xA=A and O0xA=0O. 
Multiplication of two matrices 


The product AB of two matrices A and B is defined only when the number of columns in 4 jg eau 
to the number of rows in B. Such matrices are said to be conformable for multiplication. Let 4 = (a) 
y 


be an m x n matrix and B = (5,) be ann x p matrix. Then the product matrix 


np 





m *n n * p 
is a matrix of order m x p. The general element of the product matrix C is given by 


(3.5) 


Nn 

Cy = Qb,; + Qjyba; + ... + Aigdy = Dd Fix OK; 
k= 

plied by B. . 


t-multi 
be pos att 


In the product AB, B is said to be pre-multiplied by A or A is said to - 
n x 1, then AB Is? 


If A is a row matrix of order 1 x n and B is a column matrix of order 
of order 1 x 1, that is a single element, and BA is a matrix of order n X n. 


Remark 1 -< defined bu! the 
(a) It is possible that for two given matrices A and B, the product matrix AB Is © Bis? 
3 Lea where® 


product matrix BA may not be defined. For example, if A is 4 2 x 

3 x 4 matrix, then the product matrix AB is defined and is a matrix of order“ © ” 

the product matrix BA is not defined. ii 
(b) If both the product matrices AB and BA are defined, then both $e tative: 

square matrices. In general AB + BA. Thus, the matrix product is not commu 

If_ AB = BA, then the matrices A and B are said to commute with each other ole. lel 
(c) If AB = 0, then it_does not always imply that either A = 0 or B= 0. For exa™ 


A 
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tT wale 


ah 


0 0 
then AB = : Q 0 
“ ‘| and BA = 


ax + by “ me 
(d) If AB = AC, it does not always imply that B = C 
(e) Define AX = A x A , 


+ XA (k times) Then, a matrj | . 
a « ] « i ‘ TX A S rf 
integer & is said to be nilpotent. The smallest smog 


val f as k 
of nilpotency of the matrix A. alue of k for which A 
(f) If A? = 


x OQ] } 
a= |? and B~|° 4 


= 0 for some Positive 
= 0 is called the index 
A, then A is called an idempotent 


Properties of matrix multiplication 
1. If A, B, 


matrix. 


(AB)C = A(BC) 


(associative law) 
is a matrix of order m x q. 


- If A is a matrix of Order m x n and B, C are matrices 


of order n x p, then 
A (B+ C)=AB+AC 


(left distributive law). 
- If A, B are matrices of order m x n and C is a matrix of order n x p, then 


(A+ B)C = AC + BC (right distributive law). 


- If A is a matrix of order m x n and B is a matrix of order » x DP, 
(AB) = A(a@B) = (@A)B 


for any scalar a. 


then 


3.2.2 Some Special Matrices 


We now define some special matrices. 


Transpose of a matrix The matrix obtained by interchanging the correnponuiig rows and columns 
of a given matrix A is called the transpose matrix of A and is denoted by A’ or A’, that is, if 


a); a\2 va Gy, 411 421 se Gaul 
Gas a 
a>, 4 sos My, : rs Al2 2 i 
Pe » then A’ =], 
dd) ay inyy 
a Oy Giny In =! 


Scie ee T 
If A is an m x m matrix, then A’ is an n x m matrix. Also, both the product matrices A7A and AA 
“€ defined, and 


A’A = (n X m\(mxXn)is ann xn square matrix 
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3.6 Engineering Mathematics 


an m1 x mM square matrix. 


AA! = (m X nt X m) 18 
sce Del's 


and 
A column vector b can also be written as [b, 2 


The following results can be easily verified 
1. The transpose of a row matrix 1s a CO 
a row matrix. 


lumn matrix and the transpose of a column Matty : 


-ay™* : formable for addition 
3. (A + B)’ = A’ + B’, when the matrices A and B are con Seams 1. 
-P4, (AB)! = BA’, when the matrices A and B are conformable for multiplication. 


If the product A, A) ... A, 1s defined, then 
r gf T 
[A, A, as Ad Rey Ay see A}- 


Remark 2 

The product of a row vector a; = (4;) 42 --- 
b, = (by; bo --- by)" of order n x I is called t 
a; and b,, that 1s 


a.) of order 1 x m and a column vector 
: a 
he dot product.or the inner product of the vectors 


nt 
y= aj b= Dain bey 


i 
: k=l 


which is a scalar. In terms of the inner products, the product matrix C in Eq. (3.5) can be written as 


a,b; aytby °° a,b, 
a,b, a,b, st a,‘b, 36 


a i 


‘b, a, "D> sila aD, 


Symmetric and skew-symmetric matrices A real square matrix A = (aj) is said to be 


. 2. oF 
symmetric, ifa,;=a, for all i andj, that is A= A 


; , ‘ _ T 
skew-symmetric, if a;=— a, for all i andj, thatis A=—A. 
Remark 3 
(a) In a skew-symmetric matrix A = (a,), all its diagonal elements are zero. 
(b) The matrix which is both symmetric and skew-symmetric must be a null matrix. , f 
(c) For any real square matrix A, the matrix A + A’ is always symmetric and the quer. 
is always skew-symmetric. Therefore, a real square matrix A can be written as e 
symmetric matrix and a skew-symmetric matrix, That is 
r, 1 T 
a AFA) + S (A — A’). 
7 1 = (), 
if dij 


Triangular matrices A square matrix A = (a;,) is called a lower triangular matrix angi” 
j a = a Tae = = : Fr 

whenever i <j, that is all elements above the principal diagonal are zero and an upper 7et0- 

matrix if a,, = 0. whenever i > /, that is all the elements below the principal diagonal at 


tl 
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Conjugate matrix Let A = (a;;) be a complex matrix. Let 7 a ,, denote the complex conjugate of ay. 
Then, the matrix A= (a) 1s called the conjugate matrix of ‘A 


Hermitian and skew-Hermitian matrices A complex matrix A is called an Hermitian matrix if 


A= Mae eee (A)! and a skew-Hermitian matrix if A = - - A’ or A= = -(A)’, Sometimes, a 
Hermitian matrix is denoted by A” or A*® 


Remark 4 


(a) If A is a real matrix, then an Hermitian matrix is same as a symmetric matrix and a 
skew-Hermitian matrix is same as a skew-symmetric matrix. 


Ab) Inan Hermitian matrix, all the diagonal elements are real (let a, = x, + iy, then a, = a , gives 
x, + ty = Xj — ty; OF y; = 0 for all J). 


9) In a kew-Hemitan matrix, all the diagonal elements are’ either 0 or pure imaginary 
) (let a, = x; + ty,; then a, = — a i; gives x; + ty; = — (x; — iy,) or x; = 0 for all /). 


(d) For any sina Square matrix A, the matrix A + A is always an Hermitian matrix and the 


matrix A— A’ is always a skew-Hermitian matrix. Therefore, a complex square matrix A can 
ee ee EAD TAT 
be written as the sum of an Hermitian matrix and a skew-Hermitian matrix, that is 


Am (A+ A’)+ > (A— A’). 
Example 3.1 Let A and B be two symmetric matrices of the same order. Show that the matrix AB 
is symmetric if and only if AB = BA, that is the matrices A and B commute. 
Solution Since the matrices A and B are symmetric, we have 
A’=A and B’=B. 
Let AB be symmetric. Then 
(AB)’= AB, or B’A’=AB, or BA=AB. 
Now, let AB = BA. Taking transpose on both sides, we get 
(AB)’ = (BA)’ = A’B’ = AB 


Hence, the result. 


3.2.3 Determinants 


With every square matrix A of order n, we associate a determinant of order n which is denoted by 
det (A) or |A|. The determinant has a value and this value is real if the matrix A is real and may be __ 


real or complex, if the matrix is complex. A determinant of order n is defined as 
ayy Sy. "" Oy 
| G2, 422 "* Gdn 
det(A)=|A| =] - 
Gn) 4n2 "" Gyy 
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3.8 Engineering Mathematics 


n af : A 
Y~ 1% a, My = L974 


j=! 


=| 


i] I] 
i+) wi 
dX (-1)"% a, My = * ai Aj 
/= 


j=l (3.7) 
where M,, and A, are the minors and cofactors of a,, respectively. 
We give now some important properties of determinants. 
1. If all the elements of a row (or column) are zero then the value of the determinant iS zen 
2. |A| = |A”]. | 
3. If any two rows (or columns) are interchanged, then the value of the determinan, i 
multiplied by (—1). 
4. If the corresponding elements of two rows (or columns) are proportional to each Other 
then the value of the determinant is zero. | 
5. If each element of a row (or column) is multiplied by a scalar @ then the value Of the 


SL. 


4 


determinant is multiplied by the scalar a. Therefore, if B is a factor of each element of a row 
(or column), then this factor B can be taken out of the determinant. 

Note that when we multiply a matrix by a scalar a, then every element of the matrix is 
multiplied by a. Therefore, | @A| = a" |A| where A is a matrix of order n. 

If a non-zero constant multiple of the elements of some row (or column) is added to the 
corresponding elements of some other row (or column), then the value of the determinant 
remains unchanged. 

|A + B| # |A] + |B], in general. 


Remark 5 

When the elements of the jth row are multiplied by a non-zero constant & and added to the 
corresponding elements of the ith row, we denote this operation as R; — R, + kR,, where R, is the 
ith row of |A|. The elements of the jth row remain unchanged whereas the elements of the ith row 
get changed. This operation is called an elementary row operation. Similarly, the operation 
C; — C; + kC, where C; is the ith column of |A|, is called the elementary column operation. 
Therefore, under elementary row (or column) operations, the value of a determinant is unchanged. 


Product of two determinants 


If A and B are two square matrices of the same order, then 


|AB| = |A| | BI. 
Since |A| = |A’|, we can multiply two determinants in any one of the following ways 
(1) row by row, (11) column by column, 
(iii) row by column, (iv) column by row. 


The value of the determinant is same in each case. 
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gank of a matrix 


The rank of a matrix A, denoted by r or r(A) is the order of the largest non-zero minor of | Al. 
therefore. the rank of a mat is the largest value of r, for which there exists at least one r X r= 
gubmartix of A whose determinant = not zero. Thus, for an m x n matrix r < min (m,n). For a square 
e f order n, the rank r= n if |A| #0, otherwise r < y. The rank of a null matrix is zero and 


atrix A 0 ‘ae | 
ae rank of matrix is 0, then it must be a null matrix. 
example 3.2 Find all values of 4 for which rank of the matrix 
u-l O 0O 
0 — 
i ue -l = «(0 
0 0 yp -l 
“6 lil-=6 I 


is equal to 3. 

Solution Since the matrix A is of order 4, r(A) < 4. Now, r(A) = 3, if | A| = 0 and there is at least 
one submatrix of order 3 whose determinant is not zero. Expanding the determinant through the 
elements of first row, we get 


al 0 0 -l O 
AJ=H}O pw -l}+) 0 Bw -I = u[utu-9 +11] -0 
11 -6 1 -6 -6 1 


= pp - 6 + Wp - 6 = (MIU - 2)(H - 3). 


Setting |A| = 0, we obtain pw = 1, 2, 3. For p= |, 2, 3, the determinant of the leading third order 


submatrix 
pw -l O 
JA|=]0  -l)=# #0 
0 0 Ly 


Hence, r(A) = 3, when pf = 1 or 2 or 3. For other values of pl, r(A) = 4. 


3.2.4 Inverse of a Square Matrix 


Let A = (a;,) be a square matrix of order n. Then, A is called a 


(i) singular matrix if |A| = 0, 
il cals ; - ea 
(") non-singular matrix if |A| # 0. ) <n and non-singular if its rank 


fj nk r(A 
ar if its ra if there exists a 


In 2 as 
ot ; ; singul ; 
mr words, a square matrix of seinrchearmiie 5 n is said to be invertible, 


nga n. A square non-singular matrix A of order 
“n-singular square matrix B of order ”” such that (3.8) 


AB = BA =! 
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os” 


where I is an identity matrix of order n. The matrix B is called the inverse matrix of 4 and 
write B= A™' or A = B". Hence, we say that A’ is the inverse of the matrix A, if mt 


A'A=AATEL 


The inverse, A' of the matrix A is given by 


l 
A'= 1A adj(A) 


adjoint matrix of A 
transpose of the matrix of cofactors of A. 


where adj(A) 


Remark 6 
(a) (AB)'= BA. 
We have 

(AB)(AB) | =I. 


(3.9) 


(3.10) 


Pre-multiplying both sides first by A”! and then by B™! we obtain 
B-'A~'(AB)(AB)! = B7'(A7'A) B(AB) | = B'A™ or (AB) = B'A™. 


In general, we have (A,A,... A,)' = A, Aj.) --- Al 


(b) If A and B are non-singular matrices, then AB is also a non-singular matrix. 


(c) If AB = 0 and A is a non-singular matrix, then B must be null matrix, since AB = 0 can be 
pre-multiplied by A. If B is non-singular matrix, then A must be a‘null matrix, since AB = 0 can 


be post-multiplied by B™’. 


(d) If AB = AC and A is a non-singular matrix, then B = C (see Remark 1(d)). 


(e) (A+By'#A' + B', in general. 


Properties of inverse martices 


* 1. If A ‘exists, then it is unique. 
2 (Ay = A 


3. (A7)' = (A')". (From (AA™')’ = I’ = I, we get (A')'A’ = I. Hence, the result). 
wv. Let D = diag (di, ds, LE | dis) d,, = 0. Then, Dp" — diag (1/d,,, I/d55, one 1/d,,): ' 
5, The inverse of a non-singular upper or lower triangular matrix is respectively an UPPS o 


lower triangular matrix. 


6. The inverse of a non-singular symmetric matrix is a symmetric matrix. 


ZZ 1. (A) = A" for any positive integer n. 


A 
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2 0 - 

Example 3.3. Show that the matrix A=]|5 1 0] satisfies the matrix equation A® — 6A* + 
0 | 4] 

1A-1= 0 where I is an identity matrix of order 3. Hence, find the matrix (i) A’! and (ii) A. 


solution We have 


2 0 -1//2 oO -1 4 =] <5 
A*=/15 1 OS 1 Ol=]15 1 -5 
01 31/0 1 3 5 4 9 

4 -1 -5][/2 0 -1 3 -6 -19 


A?=A7A=|15 1-5/5 1 0/=|35 -4 -30]. 
5 4 9ffo 1 3{ [30 13° 22 


Substituting in B = A® — 6A’ + 11A — I, we get 
3 -6 -19] [24 -6 =30] [22 Oo -I1] [! 9% 9 
p=|36 -—4 =30/-1/90 6 =30]+/55 11 O/-]0 TF 0 
30 13 22] |30 24 54 0 11 33] |o 0 1 
0 0 0 
=|0 0 0|/=0. 
0 0 0 


(i) Premultiplying A? — 6A? + 11A - I = 0 by A”, we get 
A7A3 — 6A7A? + 1LATA — AT = 0 


or AT'= A?- 6A + 111 
4, =f —5 12 0 -6 1 Oo 0 5 -| | 
=|15 1 -5|/-|30 6 O;+/;0 I o/=|-15 6 SI. 
5 4 9 06 18 0 0 $ -2 2 
4 wl l 3 «1 | eS of} 10 
(ii) A? = (ae =| -15 6-515 6 -5|=|-160 61 —55}. 
5 2 2 5 2 2) . 55 -21 19 


We can also write ; 
a2 =(A1) (A!) =A- 61+ IA). 


Scanned by CamScanner 





cas fics ‘ 
3.12 Engineering Mathema m of Equations 


*npe te 
3.2.5 Solution of m x Linear Sys 


wns 
: ‘no unknown 
aquations In _ 
Consider the system of # equa @ hidie™ b 
ay;X, + 412*2 a 52 “3 
+ GoyXn 72 
ity Xj Bate Te 
, + Ayaytn b,,. (3,] 
Ay |X + 4,,9%2 + ,.. nae an ) 
. tions (3.11) as 
In matrix form, we can write the system of equa 
~ (3.12) 
Ax=b 
bh, | xy 
ay 42 «+ An 
x 
7) @n = 2 com |“ 
where | A= ‘ . |? 
aiy| a2 Qn b, x 


and A, b, x are respectively called the coefficient matrix, the right hand side column vector and the 
solution vector. If b # 0, that is, at least one of the elements b,, 55, ..., b,, is not zero, then the system 
of equations is called non-homogeneous. If b = 0, then the system of equations js called 
homogeneous. The system of equations is called consistent if it has at least one solution and 
inconsistent if it has no solution. 


Non-homogeneous system of equations 
The non-homogeneous system of equations Ax = b can be solved by the following methods. 
Matrix method 


let A be non-singular. Pre-multiplying Ax=hb by ant we obtain 


x=A'p, (3.13) 


The system of equations is 
is the only solution, 





Cramer’s ry le 


Let A be non-singular, The Cramer’s rule for 


the solution of Ax = b js given by 
|A, | 
He 
ral laa ee ony alm 
Where |A_| is the determinant of the 
hand side column vector b. 
We discuss the following Cases 


pee eained by replacing the ith column of A by the ret 
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Case 1 When |A| # 0, the system of equations is consistent and the unique solution is obtained by 
ysing Eq. (3.14). 

Case 2 When |A| = 0 and one or more of |A,|, i = 1, 2, ..., m, are not zero, then the system of 
equations has no solution, that is the system is inconsistent. 

Case 3 When |A| = 0 and all |A,| = 0, 7 = 1, 2, ..., n, then the system of equations is consistent 
and has infinite number of solutions. The system of equations has at least a one-parameter family of 


solutions. 


Homogeneous system of equations 
Consider the homogeneous system of equations 


Ax = 0. (3.15) 
Trivial solution x = 0 is always a solution of this system. | 
If A is non-singular, then again x = A 0 = 0 is the solution. 


Therefore, a homogeneous system of equations is always consistent. We conclude that non-trivial 
solutions for Ax = 0 exist if and only if A is singular. In this case, the homogeneous system of 
equations has infinite number of solutions. 


Example 3.4 Show that the system of equations 
1 -l 1 || x 4 
2 1 -3]}¥y}= | 0}. 
l ] l 2 
has a unique solution. Solve this system using (i) matrix method, (ii) Cramer’s rule. 
Solution We find that | 
—_ ae 
AJ=|2 1 3) = 101+ 3)-2C-1-1) + 1-1) =10 #0. 
‘ct ot, 4 


Therefore, the coefficient matrix A is non-singular and the given system of equations has a unique 
solution. Let x = [x, y, z]’. 


4 2 2 4 
(i) We obtain At = —|-s 0 5| and b =| 0}. 
| —2 3 2 
[4 2 2}4 2 
Therefore, x=A™'b == -5 0 5) 0;/=)/-1 
1 -—2 34/2 


Hence, x=2,y=-l and z = l. 
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4-1 | _ 
, wa) edt #3) = 8 $28 = Dee 
“s 1 |A,| = 0 
(ii) We have : 
2 1 | 
1% 2 1(-12 -—0 
—- 110 + 6) — 2(4 — 2) + Ile -— 0) = - | 
A= [2 9 3] = 104+ -% . 
12 
[ <4 4 
IAJ=[2 1 0] = 12-0) - 2 2-4) + MO — 4) = 10. 
| 2 
Ay] es — WAgl ier yg 2 TAal 
Therefore, pea ee AE Pe |A| 
Example 3.5 Show that the system of equations 
2 3 IWxl=]2 
3 2 4] x, 2 
has infinite number of solutions. Hence, find the solutions. | 
Solutions We find that | 
l= 3 3 -1 3 
Al=(2 3 1/=0, jJAJ=|2. 3 = 0, 
24 5 24 
1 3 3 { Jy 3 
A, = =—* 
|A,| aon be |JAJ=]/2 3 2) =0. 
2 4 325 


Therefore, the systen nti . 
ystem of equations has infinite number of solutions. Using the first tw equation 
| . Using th 


+1 ~ t= 3~ By, 
and solving, we obtain x, =(1] - 


off of 
satisfies the third equation, ‘ soluti? 


10x35 and y. = ae 
oe ys (Sx; — 4)/5 where x, is arbitrary. Thi 
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Example 3.6 Show that the system of equations 


4 9 31x é 
2 3 Iiel=|2 
2 6 2] 2 7 
is inconsistent. 
Solution We find that 
12 2 69 3 . 3 
Al=}2 3 1/=0, IAl=|2 3 1] =0, |Al=l2 7 1|=6 
2 6 zZ 762 me 


Since |A| = 0 and |A,| # 0, the system of equations is inconsistent. 


Example 3.7 Solve the homogeneous system of equations 


[| 2g 3s 0 
2 3 -2})y)}= 10). 
4 7 4 0 


bet 


| 


Solution We find that |A| = 0. Hence, the given system has infinite number of solutions. Solving 


the first two equations 
1 2/|x| |-32z 
2 3ily 2z t 


we obtain x = 13z, y = — 8z where z is arbitrary. This solution satisfies the third equation. +t 
Exercise 3.1 \ 
I: 2 4 22 1 
1. Given the matrices A=|-1 1 1], B=|3 0 —I], verify that 
2 1 35 lL 1 = 
(i) |AB| =| A| |B), (i1) |A+ B| #|A| + |B. 


2. If A’=[1, -5, 7], B = [3, 1, 2], verify that (AB)! = B’A” 
| 2 2Z 

3. Show that the matrix A=|2 1 2| satisfies the matrix equation AY — 4A - 51 = 0. Hence, find AT, 
z. 2 a 


4. Show that the matrix A = | 2  —3) satisfies the matrix equation A>-6A?+5A + 111 =0. Hence, 
-| 3 


tJ 


find A’!. 
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0 | -i 
t 5. For the matrix A=|4 -3 4], verify that 
¥ 3 =a a 


. (i i) adj (A!” =adj(A ‘hi (ii) {adj (AT —_ dj(A'). 


mn | 
| ji 


: 
6. For the matrix A=|-2 3. 1), verify that 
| } 13 
(i) (A) = (A), Gi) (A) = 
2-1 1 i #1 
1 7. For the matrices A= |—-1 2 —-1],B=|1 3 4 , verify that 
i i « 2 209 


(i) adj (AB) =adj(A)adj(B), (ii) (A+BY'# A+B". 
8. For any nor non-singular matrix A= (a;;) of order n, show that 
(i) ) lady ( (A)| = JAI", 3 (ii)adj (adj(A)) =|Al"” 


9. For any ‘non-singular matrix A, show that |A_ ' = 1/|Al. 

| 10. For any symmetric matrix A, show that BAB’ is symmetric, wher 

a | product matrix BAB’ is defined. 

11. If A is a symmetric matrix, prove that (B 
product matrices are defined. 


12. If A and B are symmetric matrices, then prove that 
(ii) AA” and A’A are both symmetric, 






e B is any matrix for which the 


a-')7(A7'B’)-! =I where B is any matrix for which th 


(i) A+ Bis symmetric, 


ee ei 
” = Fe 
ee of — 


(iii) AB — BA is skew-symmetric. ae ee 
| 13. If A and B are non-singular commutative and symmetric matrices, then ie that 
| (i) AB . (11) A~ 'B, (11) A’ IB! 
| are symmetric. 
14. Let A be a non-singular matrix. Show that 
| (i) if 1+A+A?+...+A"=0, then A'=A’, 
jeu 2 2 
| (ii) if I-A+A?-...+(-1)"A"=0, then A™'=(-1)""'A" leh 
} 715. Let P,Q and A be non-singular square matrices of order n and PAQ = I, then show that 
16. If 1 — A is a non-singular _ then show that 
A)'=I1+A+A?+ 
| assuming that the series on the age hand side converges. igiA: 
17. For any three non-singular matrices A, B, C, each of order n, show that (ABC) —<—e 
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the following system of equation: 
18 yoy tars x+3y-z=5, xr+y-z=0. 
19, x2 432 = 6 x+4yt+z=7, 3x + 2y + 92 = 14. 


20 _xytyt2z=2 Bx-ytz=3, -xt+3y+4z=6. 
y. 2-zeh sxty=7, yr+3z=5. 


2 Determine the values of k for which the system of equations 
x—ky+z=0, kx + 3y — kz = 0, 3x+y—-z=0 


Solve 


al solution, (ii) non-trivial solution. 


@ for which the system of equations 
0, 5x+3y-z=O0hasa non-trivial solution. 


has (i) only trivi 
_ Find the value of 
a(sin Qx+Y—22=0, 3x+ 2 (cos 20) y + 3z= 


If the system of equations x + ay + az = 0, bx+y+bz=0,cx+cy+Z= 
and non-unity, has a non-trivial solution, then show that 


0, where a, b, c, are non-zero 


a b Cc 
+—— + 
l-a 1-b Il-ce 


of equations 


am] 











Find the values of A and } for which the system 
x+2y+z=6, x+ 4y + 3z= 10, x+4y+Az=H 


has (i) a unique solution, (ii) infinite number of solution, (iii) no solution. 


Find the rank of the matrix A, where A is given by 


21 -l 
xl? ** 7,|-1 -3 4 28. 
35 7 1 6 8 i. od 2 
5 4 -5 
111 , 15 4 0 gq —- & 
~1p q ri s@f-1 2 5 3/m] ° : by 
pgr 3 29 -1 | C2 
q —Ay —b, —C45 0 


31. Prove that if A is an Hermitian matrix then iA is a Skew-Hermitian matrix and if A is a Skew- 


Hermitian matrix, then iA is a Hermitian martix. 
32. Prove that if A is a real matrix and A” — 0 asn > ™, 
33, Let A, B be n x n real matrices. Then, show that 
(i) Trace (@A + BB) = a Trace (A) + B Trace (B) for any scalars a and f. 
(ii) Trace (AB) = Trace (BA), _(iii)(AB - BA = I is never true. _ 
34, If B. C are n x n matrices, A = B + C, BC = CB and C’ = 0, then show that 
A’*! — BP [B + (p + 1) C] for any positive integer p. 
35. Let A = (a;;) be a square matrix of order n, such that aj 
Al = (c — d)""' [c + (n— 1) d]. 


then I + A is invertible. 


=d,i#janda,;=c,i=jJ. Then, show that 
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rmitian, skew-Hermitian 
skew-symmetric, Herm OF Rone of these 


Identity the following matrices as symmetric, 


fm dt -o 
\ 1a bk @ 2 a be welag 8 
| i i | al - ; 
i A } 37,|h d e|- : 
id 36. |-2 5 44. | ee 
| J <4 & ee g ae oy 
| | 1 24+4i I-i | 244i I-i 0 24a 1, 
ws laeae <S aaS|. Ma l-2eae “8 3) 41.)-2+47 0 3-5 
| I+; 3+5i 6 -(-t 3-8 © J A-# 3-3 0 
Ogi 0 _j I4i ] = j 
42. |i O07 43.| -i -2% O |. 44.|-l a l=i\|, 
i i 0 _|+i 0 I —j l+r 2 
: 
; 1 2 -i 
45. |-2i i | 
i i 1 @ 
, 3.3. Vector Spaces 


of certain objects, which may be vectors, matrices, functions or some other 


Let V be a non-empty set 
: r. The elements of V are denoted by 


objects. Each object is an element of V and is called a vecto 
a, b, c, u, v, etc. Assume that the two algebraic operations 


(i) vector addition and (ii) scalar multiplication 


are defined on elements of V. 


—_ “SF i. se oF 


ea 
| If the vector addition is defined as the usual addition of vectors, then 
' | | a + b= (a, 4, «+55 a,,) + (b,, 55, ana 5.) = (a, + b,, a> Te bo, ciavg hy + b,,)- 
ee ee , o, thet 
' If the scalar multiplication is defined as the usual scalar multiplication of a vector by the scaler 


aa = a(a), 49, ..-, 4,) = (Ha, az,’..., Aa,). | 
| i | Jow ine 
The set V defines a vector space if for any elements a, b, c in V and any scalars a, B the fol 


properties (axioms) are satisfied. 
Properties (axioms) with respect to vector addition 
| 1. at+bisin V. 
: ) 2 atb=bta. (commutative law) 
| | 3. (a+b) +tc=art (b +c). (associative law) 
4.0at+ 070+ ama. (existence of a unique zero element in V) 


Fe in V) 
5. a+ (—a) = 0. (existence of additive inverse or negative veCt! in 


- — a 
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properties (axioms) with respect to scalar multiplication 


6, aa is in V. 

7, (a+ B) a= oa + Ba. (left distributive law) 

g. (aB)a = =(Ba). 

9, a(a t+ b) = wat ab. (right distributive law) 

10. 1a = (existence of multiplicative identity) 


The properties defined in 1 and 6 are called the closure properties. When these two properties are 
ed, we say that the vector space is closed under the vector addition and scalar multiplication. 
The vector addition and scalar multiplication defined above need not always be the usual addition 
and multiplication operators. Thus, the vector space depends not only on the set V of vectors, but also 
on the definition of vector addition and scalar multiplication on V. 

f V are real, then it is called a real vector space when the scalars a, B are real 
V is called a complex vector space, if the elements of V are complex and the scalars 
r complex numbers or if the elements of V are real and the scalars a, B are complex 


catisfi 


if the elements 0 
numbers, whereas 
a, B may be real o 
numbers. 


Remark 7 
(a) If even one of the above properties is not satisfied, then V is not a vector space. We usually 
check the closure properties first before checking the other properties. 
(b) The concepts of length, dot product, vector product etc. are not part of the properties to be 
satisfied. 
| (c) The set of real numbers 
| vector space only on the fields 
| spaces over arbitrary fields are considered. 
(d) The vector space V = {0} is called a trivial vector space. 





and complex numbers are called fields of scalars. We shall consider 
of scalars. In an advanced course on linear algebra, vector 


The following are some examples of vector spaces under the usual operations of vector addition and 


scalar multiplication. 
1. The set V of real or complex numbers. 
2. The set of real valued continuous functions f on any closed interval [a, b]. The 0 vector 
defined in property 4 is the zero function. 
3. The set of polynomials P,, of degree less than or equal to n. 
4. The set V of n-tuples in IR” or C’. 
5. The set V of all m x n matrices. The element 0 defined in prope 
Order m x n. 
™ following are some examples which are not vector spaces. Assume that 
‘ctor addition and scalar multiplication are being used. 
l. The set V of-all polynomials of degree n. Let P, and Q, be two polynomials of degree 
nin V. Then, aP,, + BQ, need not be a polynomial of degree n and thus may not be in V. 
For example, if P.. = xe + ax" +... + Gy, and QO, = en oF bx" © age © Bins 


then P.+@Q, isa polynomial of degree (n — 1). 


rty 4 is the null matrix of 


usual operations of 
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atang of one variable x, defined and continuous on he 
alued scones function atc, 4 <c<b, 1s some non-zero COnstan 
‘e ma elements in V. Now, f(c) = g(c) =p. Since flo) v0. 
e that if p = 0, then V forms a vector space, 


2. The set V of all real-v 
interval [a, b] such that the val 
For example, let f (x) and § (x) 
2p, f(x) + g(x) is not in V. Not 

dition 

e, 


‘th real coefficients, of degree n, where ad 
Example 3.8 Let V be the set f all olynomials, Wi : : 
i ‘d fi “ - a+ ‘ ab wna use vail scalar multiplication. Show that V is not a vector spac 
18 delin =f 


Solution let P, and Q, be two elements in V. Now, 


which is not in V. Therefore, V does not define a vector space. 


Example 3.9 Let V be the set of all ordered pairs (x, y), Where x, y are real numbers. 
Let a = (x, y,) and b = (xp, yy) be two elements in V. Define the addition as 


a + b = (x1, y1) + (X25 Y2) = (2%, — 3X2, Yi — V2) 


and the scalar multiplication as 
(x1, ¥y) = (@x,/3, ay,/3). 
Show that V is not a vector space. 
Solution We illustrate the properties that are not satisfied. 
Gi) (Xp, Y2) + Oy) = (2x — 3x1, y— Yi) # Xs Yy) + Xp, yo). 
Therefore, property 2 (commutative law) does not hold. 


(ii) (CX), yy) + (, y»)) + (X3, 3) = (2x, — 3X2, Yj — y2) + (%3, 3) 


(1, Yi) + (Cea, Y2) + (3, 93) = Oy, y,) + (2%, ~3x3, yp — ys) 

| 7 (2%, — 6x, + 9x,, Yi — Y2 + ys). 
» property 3 (associative law) does not Satisfied 
Hence, V is not a vector Space, | 


Therefore 


Example 3.10 Let V be the set of al] 


Ordered pai 
and b = (x5, y») be two elements in V Pars (x, y), 


Define the addition 
a+b = (x, 
and the scalar multiplication as 


Where x, y are real number, Let a= (tv! 
as 


Vi) + (x, y,) + = (1%, y)y>) 


| (1,4) = (ax, 
Show that V is not a vector space | 


Solution Note that 


ay). 


(1, 1) is an ele 
} ment of y. | 

From the given definition of vector addition, ¥° * 

This is true only for the ele | 
me 
dtinedlinpenicey 4 Rut (1, 1), Therefore the ele, Ee 
ves Clement (1, 1) Jemen 
» 1) plays the role of 0¢ 


P,+0,= (P,,) (Q,,) is a polynomial of d — | 





Remark 
To show 
as given 
and scal 
these pr. 
We need 
Mverse ; 
Conside, 


be] 


y 





Scanned by CamScanner 


Matrices and Eigenvalue Problems 3.21 





Now, there exists the element (I/x,, 1/y,) such that (x, 
(1/x,, /y1) Plays the role of additive inverse. 

Therefore, property 5 is satisfied. ; 
Now, let a = 1, B = 2 be any two scalars. We have 


(a + B)(x), y= 3(x,, y)) = (3x, 3y,) 


vy) + (l/x, + I/y,) = (1, 1). The element 


and a(x), ¥)) + BCX, ¥1:) = 104, y) + 2(X1, V1) = (xy, ¥y) + (2x, 2yy) = (2x7, 2y%). 
Therefore, (@ + B)(xX), ¥\) # A(x), ¥,) + Blx,, y,) and property 7 is not satisfied. 


Similarly, it can be shown that property 9 is not satisfied. Hence, V is not a vector space. 


3.3.1 Subspaces 


Let V be an arbitrary vector space defined under a given vector addition and scalar multiplication. 
A non-empty subset W of V, such that W is also a vector space under the same two operations of 
vector addition and scalar multiplication, is called a subspace of V. Thus, W is also closed under the 
two given algebraic operations on V. As a convention, the vector space V is also taken as a subspace 
of V. 


Remark 8 


To show that W is a subspace of a vector space J, it is not necessary to verify all the 10 properties 
as given in section 3.3. If it is shown that W is closed under the given definition of vector addition 
and scalar multiplication, then the properties 2, 3, 7, 8,9 and 10 are automatically satisfied because 
these properties are valid for all elements in V and hence are also valid for all elements in W. Thus, 
we need to verify the remaining properties, that is, the existence of the zero element and the additive 
inverse in W. 


1 
i 
| 
| 
f 
4 


Consider the following examples: , | 
1. Let V be the set of n-tuples (x), x2, ... x,) in IR” with usual addition and scalar multiplication. \ 


Then 
(i) W consisting of n-tuples (x), X2, «++» X,) with x) = 0 is a subspace of V. | 
., X,) with x, 20 is not a subspace of V, since W is 


ii) W consisting of n-tuples (x, 2, -- Sas it 
(ii) g Pp (ax, when ais a negative real number, 1s not in W). 


not closed under scalar multiplication : 
(iii) W consisting of n-tuples (x, X2, «++» Xn) With x, =x) + } is not a subspace of V, since W 

is not closed under addition. 

(Let x = (x), Xp, «++» Xn) with x, =x, + | and y =(), Ya 

elements in W. Then 

x ty = (x) ty p%2 t Va ee Xr + y,) 

+2#x,+y, + 1). 
e < m with usual addition and scalar 


sa, ,) With y, = y, + | be two 


is not in W as x5 + y2 =X TH 
2. Let V be the set of all real polynomials P of degre 
multiplication. Then 


it =01 V. 
(i) W consisting of all real polynomials of degree < m with P(0) 0 is a subspace of 
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(ii) W consisting of all real polynomials of degree < m with P(0)= 1 is nota gy | 
- ddition (if Pand QO € W, then P+ SPace 
V. since W is not closed under addaitro : isn O¢ W. of 
(iii) W consisting of all polynomials of degree < m with real positive Coefficients 
subspace of V since W is not closed under scalar multiplication (if P is ap : 
W,then—P¢€ W). 
3. Let V be the set of all m x m real square 
multiplication. Then 
(i) W consisting of all symmetric/skew-sym 
(ii) W consisting of all upper/lower triangular matrices of order 7 is a subspace of y 
(iii) W consisting ofalln xn matrices having real positive elements IS NOt a subspace ofy 
since W is not closed under scalar multiplication (if A is an element of W 


then—Aé WW). 
4. Let V be the set of al 
multiplication. Then 


a 
Clemen; t 


matrices with usual matrix addition and 
SCalar 


metric matrices of order 7 is a subspace 
, ofy 


1 » x n complex matrices with usual matrix addition and scala 


(i) W consisting of all Hermitian matrices of order n forms a vector space when scalar 
are real numbers and does not form a vector space when scalars are complex numbers 


(W is not closed under scalar multiplication). 
a xX+I 
Let A= ( | ‘i EW. 
x-ty) b 


; al xi-y 
Let a=i. Weget aA=iA= ¢ W. 
7 xi+y bi 


r space when 


| (ii) W consisting of all skew-Hermitian matrices of order m forms a vecto i 
p i 


scalars are real numbers and does not form a vector space when scalars are com 
numbers. 


f of xt+iy 
Let A= e W. 
—x+iy i 


- a A i 


Let a=i. We get ia=( . i *)ew 
The sum © 
Example 3.11 Let F and G be subspaces of a vector space V such that FO G = {0}. 


F and G is written as F + G and is defined by 
F+trGe= {if+ge:fe Fr, ge G}. 


Show that F + G is a subspace of V assuming the usual definition of vector additi 


on 


multiplication. r 
Solution Let W=F +O and f € F, ge G. Since 0 € F, and0 € G we have 0+ 
Let f, + g, and f, + 82 belong to W where f,, f, ¢ F and g,, g, € G. Then 
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(f, + 2) + (f, + 82) = (f, + fh) + (g, + g,)6 F+G=wW. 


ny scalar, a(ft+gy=-aftage F+G=wW. 


for 4 
Als0- w=F+Gisa subspace of V. 


therefore. 
We now state an important result on subspaces. 
nov 


rem 3.1 Let Vj, V2. +++» ¥, be any r elements of a vector space V under usual vector addition 
multiplication. Then, the set of all linear combinations of these elements, that is the set 


ad scalar 
and s ts of the form 


of all elemen 





av, + Q5V5 Tt vee a .Y, (3.16) 


Spanning set Let S be a subset of a vector space V and suppose that every element in V can be 
obtained as a linear combination of the elements taken from S. Then S is said to be the spanning set 
for V. We also say that S spans V. 


Example 3.12 Let V be the vector space of all 2 x 2 real matrices. Show that the sets 


sf le atl ole a) 
‘ Ce) 


span V 


—) 


a 


| 
| 
| 
| 


b 
Solution Let x = ? i be an arbitrary element of /. 
c 


edna eels elec aleele sh 


Since every element of V can be written as a linear combination of the elements of S, the set 
S spans the vector space V. 


(i) We write 


(i!) We need to determine the scalars Ql, ly, O13, 4 SO that 


eared deaf olrel deeb J 


Equating the corresponding elements, we obtain the system of equations 


Q+a,=c, a =d. 


SS Se Oa Se SS em 


—= 
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jons 1S 

The solution of this system of equal h=c, @ =a- b. 
a,= d. a,=c7-4, a os 

4 ee 4 e 


Therefore, we can write 


1 0 _ +e-d) | ) 
p *)= 10H 5] £O- Ao 0 1 90 Lif 
jc 


Si very element of V can be written as a linear combination of the elements of Sth 
since ever | pw | 


set S spans the vector space ¥ | 
Let V be the vector space of all polynomials of degree < 3. Determine whether o 


















Example 3.13 | 
not the set - 
s={o,P+,e ttt i} Lae 

spans V ? ympart 
Solution Let P(t) = at? + Br> + yt+ 6 be an arbitrary element in V. We need to find whether : OSE 
b | tens 
not there exist scalars a,, aj, a; such that oan ants 
a+ Bet y+ b=a, + a(t? +) + a(t? +14 1) es: 


pate. . 


+s . 


ar + Br + yt + d= (a, + a;)t° + ayt? + (a, + a3) t + ay. 
Comparing the coefficients of various powers of t, we get 


a, +a,= 4, a, = B, a,+a,=¥, a,=0 


The solution of the first three equations is given by 


_ a=-atBp-y, a, = Bp, a,=y- fp. 
feel “oe a Me potain Y~ B = 8, which may not be true for all elements in! 
be written as a then salen of ie ne not satisfy this condition and therefore, it cant” 
space V, tements of §. Therefore, S does not span the veclor 


3.3.2 Linear Independence of Vectors 


Let V be a vector Space. A fj 


nite set 
dependent if there ex; IViy Vo, 
exist 5 | 2 
scalars 1, Ob, ..., 


“» Yn} Of the elements of Vis said to be Hinea"? 
not all zero, such that 
TV. + ay, + 
9 Peo as | 1) 
ed only for cr, av, =U, 3 


= Q, = 1. = _ : ly 
a, 0, then the set of vectors is said to be [ineah. 


Oy, 


If Eq. (3.17) is Satisf} 
independent, 


The above definition of linear de 





Pendence of y 
et of ve 
Clors {y,, Mae 


Mbination of the engine dependent if and only if at least 
“ng element 
Ss. 


Theorem 3,2 The s 
element of the set 


I» Va, 


" ; Ws: 
Yn Can be Written alternately as follo 
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remark 7 | | | is | seit 
3.17) gives a homogeneous system of algebraic equations. Non-trivial solutions exist if 


‘ efficient matrix) = 0, that is the vectors are linearly dependent in this case. If the det(coefficient 
yer #0, then by Cramer's rule, @, = @ =... = @, = 0 and the vectors are linearly independent. 


ple 3.14 Let vy) ~ (1, -1, 0), v; = (0, 1, -1) and v, = (0, 0, 1) be elements of IR>. Show that 


Exam ant : 
{v,, V3, ¥3} is linearly independent. 


the set of vectors 


Solution We consider the vector equation 


OV, + QV, + Vv; = 0. 
Substituting for V), V2, V3, We obtain 
aj(1, -1, 0) + @,(0, 1, - 1) + a,(0, 0, 1) = 0 


or (Q, — a, + &, — A+ a) = 0. 


Comparing, We obtain a, = 0, — a, + a& = 0 and -a@+ a, = 9. The solution of these equations 


is Q = O& = 03 = 0. Therefore, the given set of vectors is linearly independent. 
Alternative 
1 0 0 
det(v,, V.,V3)=|-1 1 OO) =1#0. 
0 -1 1 


Therefore, the given vectors are linearly independent. 


Example 3.15 Let v, = (1, —1, 0), v2 = (0, 1, —1), ¥3 = (0, 2, 1) and v4 = (1, 0, 3) be elements 
of IR?. Show that the set of vectors {v, V2 V3 V4} is linearly dependent. 


Solution The given set of elements will be linearly dependent if there exist scalars @, Q, A, &%, 


not all zero, such that 
ayy) 1 OnV9 + O4V3 +. O4V4 = 0. (3.18) 


Substituting for v,, V>, V3, V4 and comparing, we obtain 


The solution of this system of equations is 
Q,=- A, = 5a,/3, A= - 4a,/3, @, arbitrary. 


Substituting in Eq. (3.18) and cancelling 04, we obtain 
5 4 
ed “ mS v,+ v,= 0. 


Hence, there exist scalars not all zero, such that Eq. (3.18) is satisfied. Therefore, the set of vectors 
'S linearly dependent. 
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3.3.3. Dimension and Basis 


Let V be a vector space. If for some positive integer n, there exists a set 5 of n linearly Indep 
elements of V and if every set of n + | or more elements in V’ Is linearly dependent. then i 
to have dimension n. Then, we write dim (V) =n. Thus, the maximum number of linearly indep “ 
elements of V is the dimension of V’. The set S of # linearly independent vectors jg calle 
basis of V. Note that a vector space whose only element is zero has dimension zero. ™ 


Theorem 3.3 Let l’ be a vector space of dimension n. Let vj, V>, ..., V,, be the linearly inde 
elements of V. Then, every other element of V can be written as a linear combination 
elements. Further, this representation is unique. 


Penden 
OF these 


Proof Let v be an element of V. Then, the set {v, Vv), ..-. V, 1S linearly dependent as it has 


elements. Therefore, there exist scalars Q, @), ..., @,, not all zero, such that 
OV + av) nn QAnV yn = 0. (3.19) 


Now, @, # 0. Because, if a, = 0, we get a,v, +... + @,,V,, = 0 and since v,, v,, ..., V,, are linearly 
independent, we get @, = Q@, =... = a, = 0. This implies that the set of n + 1 elements y. Visca: 
v, 1S linearly independent, which is not possible as the dimension of V is n. 

Therefore, we obtain from Eg. (3.19) 


v= > (— a,/ap)v,. (3.20) 


i=l 
Hence, v is a linear combination of n linearly independent vectors of V. 
Now, let there be two representations of v given by 

V=a,v, + anv, +... + a,v, and v= b,v, + bv, +... + 5,Y, 
where 6, # a; for af least one i. Subtracting these two equations, we get 

0 = (a, — d))v, i (4 — by)v. + ... + (a, — b,)v,,. 
Since v,, Vz, .-. V,, are linearly independent, we get 

aj-—6,=0 or a;= 6b, i= 1,2, ..., n. 

Therefore, both the representations of v are same and 
IS unique. 
Remark 10 


(a) A set of (m + 1) vectors in IR” is linearly dependent. 


(b) A set of vectors containing 0 as one of its eleme 
combination of any set of vectors. 


20) 
the representation of v given by Eq. (3. 


‘neal 
4 og 5 the line 
nts is linearly dependent as 9 'S th 


caserll 
lined" 
Space. If v,, Vo, ...5 Ve kK <2 aS vj 5 


a! 


Vi+ts Verrs ---) V, Such that {¥); Vaan”? 


Theorem 3.4 Let V be an n-dimensional vector 
independent elements of V, then there exist elements 
a basis of V. 


| A 
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proof ‘Thee exists an element V+; Such that v,, v,, ..., Ye, Ves, are linearly independent. 
Otherwise, every element of V can be written as a linear combination of the vectors Vv), Vo, 0: v; 
and therefore V has dimension k < n. This argument can be continued. If >k+ 1, we keep adding 
elements Vy+i+ Vi+2» «+++ Vn such that {v,, V2, «.-, V,} iS a basis of V. | 
since all the elements of a vector space V of dimension n can be represented as linear combinations 
of the n elements in the basis of V, the basis of V spans V. However, there can be many basis for the 
game vector space. For example, consider the vector space IR*. Each of | 

(i) (1, -1, 0}, (0, 1, -1], [0, 0, 1] 

(i) (l, -l, 0}. (0, 0, 1], [1, 2; 3] 

(ii) (1, 0, 0}, (0, 1, 0}, (0, 0, 1] 


the following set of vectors 


are linearly independent and therefore forms a basis in IR?. Some of the standard basis are the 
following. 
1. If V consists of n-tuples in IR”, then 
&) = (1,0, 0, ...5 0), = O,.1,, v5 9); 0055, = (0, 0,-5.0, 1) 
is called a standard basis in IR”. 


2. If V consists of all m x n matrices, then 


O ws  «z. 8 
Be= 10 wa 1 ws OF PETZ a m and s=1,2,...,7 
GO ac @ 0 


where | is located in the (r, s) location, that is the rth row and the sth column, is called its 
standard basis. 


aw Ol. a 
For example, if V consists of all 2 x 3 matrices, then any matrix ° F | in V can be 
written as 


b 
; G] = aE + PEn + ey +E +yEn + 2B 


x y z 
1 0 0 01 0 
| = , = tc. 
where E,, hi a a} E)> » 6 4 etc 
3. If V consists of all polynomials P(t) of degree < n, then ‘1,4, 07, ..., ¢"} is taken as its 
Standard basis. 


Example 3.16 Determine whether the following set of vectors {u, v, w} forms a basis in IR°, where 
(i) uw = (2, 2, 0), v = (3, 0, 2), w = (2, -2, 2) 
(ii) u = (0, l, -1), v= (-1, 0, -1), w= G, l, 3). 
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in IR?, then u, v, W must be linearly indep 


Solution If the set {u, v, w} forms a basis 
: . ly solution of the equation PENdeny 
at Let a, Q, @ be scalars, Then, the only s 
ie + aw = 0 
Big au tf Qf3V 3 (3) 


ae. | must be @, = Q@, = a = 0. 

Hig (i) Using Eq. (3.21), we obtain the system of equations 
1 iG gi a . 
ia 8 2a, + 3a, + 20,= 9, 2a,-—20,=0 and 20, + 2a, = 0. 


= = = 0. There , . 
The solution of this system of equations is @ = 0 ~ ; efore, u, v, w Are linear 


iil independent and they form a basis in IR’. 
(ii) Using Eq. (3.21), we obtain the system of equations 
—~a,+30,=0, a + % =9, and — @, — & + 3a,=0. 


The solution of this system of equations is Q = Q = a; = 0. Therefore, u, v, w are linearly 


independent and they form a basis in IR?. 
Example 3.17 Find the dimension of the subspace of IR* spanned by the set {(1 0 0 0), (0109) 
(1 2 0 1), (0 0 O 1)}. Hence find its basis. 
| | ' Solution The dimension of the subspace is < 4. If it is 4, then the only solution of the vector 
tay : equation 
a(1000)+a,(010 0)+a,(1201)+a,(00 00 1)=0 (3.22) 
should be @, = @ = @3 = @, = 0. Comparing, we obtain the system of equations 


The solution of this system of equations is given by 


O,= Ay, O% =204, A =—- a4, where 4, is arbitrary: 


‘ ; : fore, 
Hence, the vector equation (3.22) is satisfied for non-zero values of 0¢),.Q5, %, and at. There 


the dimension of the set is less than 4. 
ide 
: Now, consider any three elements of the set, say (1 0 0 0), (0 1 0 0) and (1 2 0 1). Cons 
aie : vector equation of 
| (3.2 
a1000)+a,0100)+a,(1 20 1)=8%. 


r the 


== ee Se Se ee oe _s 
= ro = = « =—s_ er 


Comparing, we obtain the system of equations 


iad | a, + @,= 0, & + 2a@,=0 and a, = 0. ‘ois 
are nee” 
lements 4 act0t 


Ee | The solution of this system of equations is a, = a, = a, = 0. Hence, these three € e 
i] ! he Se 


independent. Therefore, the dimension of the given subspace is 3 and the basis is t 
(1 000),(0 100), (1 2 0 1)}. We find that the fourth vector can be written as 


attr (000 1)=(1000)-2c0100)+ 171 2 0 1). 


a ag 
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pxample 3.18 Let u = {(a, b, c, d), such that a +c +d=0, b + d= 0} be a subspace of IR‘. Find 
- 4imension and the basis of the subspace. 


solution U satisfies the closure properties. From the given equations, we have 


a+c+d=QOandb+d=0 or a=-c-—dandb=-d. 


we have two free parameters, say, c and d. Therefore, the dimension of the given subspace is 2. Choosing 
-20,= 1 andc = 1,d=0 we may write a basis as {(-1 -1 0 1), (-1 0 1 0)}. 


3.34 Linear transformations 


Let A and B be two arbitrary sets. A rule that assigns to elements of A exactly one element of B is called 
. function or a mapping or a transformation. Thus, a transformation maps the elements of A into the 
elements of B. The set A is called the domain of the transformation. We use capital letters T, S etc. to 
jemote a transformation. If 7 is a transformation from A into B, we write 


T:A->B. (3.24) 
For each element a € A, we get a unique element b € B. we write b = 7(a) or b = Ta and b Is called 
the image of a under the mapping 7. The collection of all such images in B is called the range or the 
image set of the transformation 7. 
In this section, we shall discuss mapping from a vector space into a vector space. Let V and W be two 
vector spaces, both real or complex, over the same field F of scalars. Let T be a mapping from V into 
W. The mapping T is said to be a linear transformation or a linear mapping, if it satisfies the following 
two properties: 

(i) For every scalar a and every element v in V 


T(av) = aT(vy). (3.25) 


(ii) For any two elements v,, V2 in V 


T (Vv, + V2) = T(¥,) + (¥2)- 
Since V is a vector space, the product av and the sum v, + V2 are defined and are elements in V. Then, T 
defines a mapping from V into W. Since T(v,) and 7 (v,) are in W, the product a@7(v) and the sum T (v,) 
+(V,) are in W. The conditions given in Eqs. (3.25) and (3.26) are equivalent to 


T(av, + By) =T(@v;) + T(Bv2) = AT (¥,) + BTW) 


(3.26) 


for v, and vy, in V and any scalars @, B. 


Let V be a vector space of dimension n and let the set {Vj}, V> ..» V,} be its basis. Then, any element 


Vin Vcan be written as a linear combination of the elements Vj, V2; ++» Yn: 
Remark 11 
A linear transformation is completely determined by its action on basis vectors of a vector space, 


Letting a = 0 in Eq. (3.25), we find that for every element v in V 
T(Ov) = T(0) = OT(¥) = 0. 
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3.30 Engineering Mathem element in W by the linear transforma | 


 ceecvpenmed ma 252 is written as ra 
Therefore, the zero element In ion ami called the rans© al fenem his Son “iq 
elements W = TV 9 element by the | eels Call 


The collection of all 
of all elements of V’ that are mappe 


the kernel or the null-space of 7 an - 
ker(T) = (¥ | T(¥) = 
pace of I’ and the rang 


al ker(T). Therefore, we have ‘a 
is | 
and ran(T) = {T(y) | we: Fh. 


e of T is a subspace of W. 


Thus, the null space of T is a subs 


ion of ker(T) is called the nyjj; UV 
— -(T) and the dimension 7 lity of enh 
The dimension of ran(T) !s called the rank(7’) | a 
, following result. . . , 
We have the | , ‘on of V is n, then the nullity of Tis n~> thy F 
Theorem 3.5 If 7 has rank r and the dimens lis. | 
rank (7) + nullity = 7 = dim (V). 
We shall discuss the linear transformation only in the context of matrices. 
Let A be an m Xn real (or complex) matrix. Let the rows of A represent the elements in IR" (or Cy | 
“ . ] n , i . 
and the columns of A represent the elements in IR” (or C"). If_x 1s in IR", then AX is in IR”, Thy 
an m X n matrix maps the elements in IR” into the elements In IR”. We write 
: , ) | Example . 
T=A:1R" 5 IR”, and 7x = Ax. | ae 
The mapping A is a linear transformation. The range of Tis a linear subspace of IR” and the kemdl FP 
of 7 is a linear subspace of IR”. | 
Remark 12 | Solution 
T must be 


Let 7, and T, be linear transformations from V into W. We define the sum 7, + 7; to be tk 
transformation S§ such that ? ; 

| Sv = Tv + Toy, ve V. 
Then, 7, + 7; is’a linear ty mati 

i+ 7, r transformation and i, +t, = T, + T,. 
Example 3.19 Let T be a a linear 


( 


transformation defined by 


TS CEC I-} te a-( 


0 | 


; 4 § 
Find T HE 
( 3 oy 
Soluti : | 
ion The matrices | k | k O1To 9 | 
basis in the space of 2 x 2 matr; LI iflg 1 | “Te linearly independent and hence iF | 
TERE. We Write for an ‘hig 
Y Scalars 1, O, Of, Oy, not all zero 8 th, 
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Seal; j)+ay i} 0 0 0 0 
= + 
38) “Ui ba la a So 


= sad a, +a, 
A, +A, +a, OQ, +@,+A,+ a, | 


Comparing the elements and solving the resulting system of equations, we get a, = 4, @ = I, 
= 2. A, = 5. Since T is a linear transformation, we get 


De et Doe heal 


1 -| =9 
= 4/2] + 1/-2|-—21-2] +5} 2] =] 20]. 
3] 3 3 3 36 





Example 3.20 For the set of vectors {x,, X)}, where x, = (1, 3)", x» = (4, 6)", are in IR’, find the 
matrix of linear transformation T : IR? — IR°, such that 


Tx,=(-2 2 -7)" and Tx,=(-2 -4 -10)’. 


Solution The transformation 7 maps column vector in IR2 into column vectors in IR*. Therefore, 
T must be a matrix A of order 3 x 2. Let 


| a b, 
| A = a> by : 
| a, 5b, 
| Therefore, we have 
a, b|[3]- 2} and |a, b ||] —4 |. 
F 6, | 
a, b, | —'] | a, b, 10 | 
Multiplying and comparing the corresponding elements, we get 
a, + 3b, = 2, 4a, + 6b, = — 4, 


Solyj 
ving these equations, we obtain 
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— Five) 2. 
Example 3.21 Let 7 be a linear transformation from IR° into IR“, where 


Tx = Ax, A= 7 “ x=(x y x)! Find ker(T), ran(T) and their dimensions. 
-1 0 If} 7 


; We soy, Tr 
Solution To find ker(T), we need to determine all v = (UV, U2 03) such that Ty = 0, \ 


Tv = Av = 0 gives the equations oy, 
v, + v, = 0, —~o, +0, =0 
T 
whose solution is v,; = — 02 = V3. Therefore v = v,;[1 —1 1]. 
Hence, dimension of ker(7) is I. 
Now, ran(T) is defined as {T(v) | v € V}. We have 
vj | 
bd Ol, | a 
eee he ge i —vU, +03 
03 
Ss en 0 
l l 0 . 
Since ' = of=lip the dimension of ran(T) is 2. 
Example 3.22 Find the matrix of a linear transformation T from IR? into IR? such that 
| 6 l Zz l 6 
Ti) 1) =)2), T)-l/=|-4]|, 7] —2 |=] 6], 
4 | 2 3) \5 
nis? 


: ; . 10 
Solution The transformation T maps elements in IR? into IR?. Therefore, the transforma 
matrix of order 3 x 3. Let this matrix be written as 


@, Q a; 
f=-A=|8, Bs B, |. 
Y1 Yo Yi 


We determine the elements of the matrix A such that 


a, a a@;|[l] [6] fa, a, a@,)f 1 2] fa, a, a;]| ! 
B, B; B; li 2 , B, B, B, }-l}=|-41, | B, B; B; —2 |= 
Y, 2 344! 4) 1% Fo Yell 1] | 2 Y, 2 43 3 


Equating the elements and solving the resulting equations, we obtain 
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Zz 6g 
A= |-15/2 3. 13/2). 
1 2 


Fxample 3.23 Let 7 be a transformation from IR° into IR! defined by 
T(X\, X2, %3) =x} + x3 + x4. 
Show that 7 is not a linear transformation. 
Solution Let x = (Xj, %5, x3) and y = (yj, >, y3) be any two elements in IR>. Then 
RA Y= (y+ Ys Xz + Ya, Xy + V3). 
We have 
M(x)= x, +x54+x4, Ny) =r t yo +3 
T(x + y) = (x1 + yi)” + (ey + yn)? + (xs + 5)? # TOX) + TOY). 


Therefore, 7 is not a linear transformation. 


Matrix representation of a linear transformation 


We observe from the earlier discussion that a matrix A of order m X n is a linear transformation which 
maps the elements in IR” into the elements in IR”. Now, let T be a linear transformation from a finite 
dimensional vector space into another finite dimensional vector space over the same field F. We shall 
now show that with this linear transformation, we may associate a matrix A. 


Let V and W be respectively, n-dimensional and m-dimensional vector spaces over the same field F. 
Let T be a linear transformation such that 7: V — W. Let 


x= {V), V>, er V,$5 y = {W), W>, esi Wit 


be the ordered basis of V and W respectively. Let v be an arbitrary element in V and w be an arbitrary 
element in W. Then, there exist scalars, 0), Q>, ..., &, and B), B, ..., 8, not all zero, such that 


V = QV, + Gov, +... + QV, (3.271) 
w= Bw, + Bow, t+... + BW (3.27 ii) 

and w= Tv = 7T(Q@)V, + Q2v, +... + a,V,,) 
= aly + Qa ¥g% 0+ 2,7, (3.27 iil) 


Since every element Tv, i= 1,2, ..., is in W, it can be written as a linear combination of the basis 
Vectors Wi, W>, w,, in W. That is, there exist scalars a, 1 = 1,2, ....9, f= 1, 2, .... m not all 
Z€T0, such that 


ia, | 


Tv; = a; + Aa;W Ft ..6 F Ani Wm 


Fy 
[ Wy, Woy ees Woy) [Qyjs Fajr veer Amilo E = 1, 25 ceey (3.27 iv) 


lI 


H ; 
“NCe, we can write 
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ay] ay Gy, 
a> 47 A>, 
; 7 , aay W . 
T Vy. Voy ee Vy) = LWis 2) nm] : (3,2) 
\) 
eT Amy? Qin 


or 7Tx=yA 
where A is the wm X nm matrix 
a, 42 - An 
a5, a9 sae A5y, . : 
A= : , (3.27 vi) 


Am) m2 &mn 


The m x n matrix A is called the matrix representation of 7 or the matrix of T with respect to th 
ordered basis x and y. It may be observed that x is a basis of the vector space V, on which T acy 
and y is the basis of the vector space W that contains the range of-7. Therefore, the matrix 
representation of 7 depends not only on 7 but also on the basis x and y. For a given linear 
transformation 7, the elements a; of the matrix A = (a,;) are determined from (3.27 v), using the given 
basis vectors in x and y. From (3. 27 iii), we have (using 3.27iv) 


OLj(a Wy + Gay Wo FH o-- Fy { Woy) + Ola(Qy2Wy + Ap2Wa + oF 2Mal 


Ww 


+ 


oon + (a), + az,W> + myer + AnnWm) 


(ja, + QyQ,2 +... + A,Qy,) Wy + (Q) a>, + Ong, + o1. + Oj42u)™2 
ices (@)4,,) - Oy Anat ove T On Ann) Wy. 


Bw, + fiw, Tee mW m 


where B, Oa), F Agty +... Pa, P= 1, 2, «5! 
B, Qjy yQ2 wee Ay | Of 
Hence, Po =| 921 922 + Gan 2 
B m Any — Im Ginn | & n 
or Bp=Aa 
where the matrix A is as defined in (3.27 vi) and 
B= [By Bay + yl", a = [O,, Ol, «++, a)". , linet 


For a given ordered basis vectors x and y of vector spaces V and W respectively: os - yt ® 

= - & | 
transformation 7: V — W, the matrix A obtained from (3.27 v) is unique. We prove tn 
follows: 


a 
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pet A = (a,) and B = (6,;) be two matrices each of order m x n such that 
[x= yA and Tx = yB. 


Therefore, we have 
yA = yB 


nn m 


Dy Wa= DL woz, f= 1, 2, 0, 0. 


i=] j=| 


or 
since Y = {wW), Wo, .-+. Wm} 1S a given basis, we obtain a; = b, for all i and j and hence A = B. 
Example 3.24 Let 7: IR? — IR? be a linear transformation defined by 


: + 
T\ y\= ? ‘| 
yore 


2 


Determine the matrix of the linear transformation 7, with respect to the ordered basis 


1) (0) (0 
AL 4 ry Tet ‘ 
(i) x= s/O,/1),;0]7 in IRX and y= {o}(c} in IR 
0) \O) \1)] - 7 


(standard basis e,, €5, @3 in IR? and @), @> In IR’). 


(O\ (1) (1 
is l =. gr : 2 
(ii) x= 9/1,/0,])1]7 m IR’ and y= () ("I in IR”. 
1) (1) (0 | 
Solution Let V = IR°, W = IR’. Let x = {v,, V>, V3}, y = {W), Wo}- 
| iB 0 0 0 
(1) We have v,=/0], vy=lll, vw=alo, wir 6p W>= | 
0 0 ] 
| 0 , 
| | I 0 
We obtain 710] = v = : (0) + | (OY. FLL] =). )= | Jo, 
0 0 0 l 0 1} \0 | 


Ee 


Using the notation given in (3.27 v), that is Tx = yA, we write 
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O11 | 
T [Vj V2. Val = [Wi Wally yo 


«oft tol [hCl + -J 


Therefore, the matrix of the linear transformation T with respect to the given basis Vectors 


by S Biv 
he 01 1 
10 1 - 
0 I | 
(ii) We have Yi=([l, vw=|/9. wll, w= " m=(') 
0 = 
| 1 | 
We obtain - J] 1 -(3)- (os Jo. T\0 -( J-(Jo-{ Joa 
: 0 | =x = l re) 


[OOo 


Using (3.27 v), that is Tx = yA, we write 
0) /1 ] , 
I ] Lt 4 | 
MC OIE + g 
1) (1) (0 ss 


. , .. givel 
Therefore, the matrix of the linear transformation T with respect to the given basis vectors » given 
by | 


| 
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piscuss whether V defined in problems 1 to 10 is a vector space. If V’ is not a vector space, state 
which of the properties are not satisfied. 


Le of the real polynomials of degree < m and having 2 as a root with the usual addition 
and scalar multiplication. 


2, Let V be the set of all real polynomials of degree 4 or 6 with the usual addition and scalar 
multiplication. 

3. Let V be the set of all real polynomials of degree > 4 with the usual addition and scalar multiplication. 

4, Let V be the set of all rational numbers with the usual addition and scalar multiplication. 

5, Let V’ be the set of all positive real numbers with addition defined as x + y = xy and usual scalar 
multiplication. 

6. Let }’ be the set of all ordered pairs (x, y) in IR? with vector addition defined as (x, vy) + (u, v) = 
(x + u, y+ 0) and scalar multiplication defined as a(x, y) = (3ax, y). 

7. Let V be the set of all ordered triplets (x, y, z), x, y, 2 € IR, with vector addition defined as 


(x, ¥, z) + (u, v, w) = (3x + 4u, y — 20, z+ w) 
and scalar multiplication defined as 
Q(x, vy, z) = (ax, ay, Az/3). 


8. Let V be the set of all positive real numbers with addition defined as x + y = xy and scalar 
multiplication defined as ax = x*. 


9. Let V be the set of all positive real valued continuous functions fon [a, 5] such that 


b b 7 
(i) | J (x)dx = 0 and (ii) J F(x) dx = 2 with usual addition and scalar multiplication. 
a a 


Let V be the set of all solutions of the 

(i) homogeneous linear differential equation y” — 3)’ + 2y = 0. 

(ii) non-homogeneous linear differential equation y” — 3y’ + 2y =x. 
under the usual addition and scalar multiplication. 
Is Wa subspace of V in problems 11 to 15? If not, state why? 


11. Let V be the set of all 3 x 1 real matrices with usual matrix addition and scalar multiplication and W 
consisting of all 3 x 1 real matrices of the from 


a a a | a 
(i)] b }, (ii) | a |, (iii) |b], (iv) |b]. 
a+b a’ 2 0 


12. Let V be the set of all 3 x 3 real matrices with the usual matrix addition and scalar multiplication and 
W consisting of all 3 x 3 matrices A which 
(i) have positive elements, (ii) are non-singular, 
(iii) are symmetric, (iv) A°=A. 
13. Let V be the set of all 2 x 2 complex matrices with the usual matrix addition and scalar multiplication 
and W consisting of all matrices with the usual addition and scalar multiplication and W consisting 
Zz wre where x, y, z, u are real numbers and (i) scalars are real 


of all martices of the form ; 
b at u 


numbers, (ii) scalars are complex numbers. 
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——— non degree = 4 with the on polynomial addition . 
real polynomials Oak of degree S 4 having 

: | poly | 

(ii) coefficient of 


| 
| | iii (i) constant term I, (iv) only real roots. 
| 


nd 
Gl, 


14. Let V consist of all 


, consisting of -_ 
multiplication and HW’ cons!s g 


of the form (xy. *2 x) in IR° = ai addition g 

t of plete of the form (*1, *2 x;) such Me 
(ii) y= 7 a 

(iv) x4 + txy Ss. ty) ays = IEEE . 

a3), Determine whether or not X is a linear COmbina . 


| 3 
Te (iii) coefficient of ras |, 


ector space of all 
e the se 


Nd se 
triplet 
15. Let l’ be the v 
multiplication and Hb 
(1) vy = 2N; = 3X4. 


(iii) x, 2 0, .X9.-%3 arbitrary, ! 
—|), y= (2, 3,4) and w= (1, 2s 


—i———e = —* 3s : - 
ee eee = -- 
«i = = 


ft) 16. Letu=(1, 2, 4 oteti bY 
ti of uy Vy Wy Where x is given 7 2.5) (iii) (—2, 1, —5). 
EY Il , = , ° 
| 8 (i) (4, 3, 10), 6 a8 1j and w = (2, 3,1, -1)- Determine whether or not x iS a line 
H 7%, Letwa{ly-t WS Gy ee 
a combination of u, Vv. W, where x Is given by i) (4.3.0.3 
Pig | i) (3,0, 5-1 (ii) (2,-7, 1, 1D), Ae ) 
| 18 m,. o-F At — 6, Pa(t) = 202 — Tt— 8 P(t) = 2t- 3, Write EG ESS ERNST a 
be . | ~ i 7 = 
Tt P(t), P(t), when . hs ‘ 

: H (i) P()=-t'?+ l, (ii) P(t) = 21° —3t—-25. , = 
| | 19. Let V be the set of all 3 x | real matrices. Show that the set | J Exe 
bit 1) ( 1) (0 
| S=4] 1}, |—-1}, | 0]? spans V, 

| 0 0) \l 


20. Let V be the set of all 2 x 2 real matrices. Show that the set 


AGED G FC Zp 


21. Examine whether the following vectors in 1R2/C? 
(i) (2, 2, 1), (1,-1, 1), (1, 0, 1), 
(iii) (0, 0, 0), (1, 2, 3), (3, 4,5}. 
(v) (1,3, 4), (1, 1, 0), (1, 4, 2), (1, -2, 1). 
22. Examine whether the following vectors j 
(1) (4, 1, 2, -6), (1, 1, 0, 3), 
(1) Cl, 2, 3215,.02. 1,-l,1 


are linearly independent. . 
(ii) (1, 2, 3), (3, 4, 5), (6, 7, 8), “Fin 
(iv) (2, 7,-1), (1, -3, 4), (2i, -1, 5) 


n IR? are linearly independent. 
a, ~|, 0, 2), (—2, bs 0, 3), 
)s (4, 5,5, 3), (5,4 1, 3), 


(ii) (1, 2, 3, 4), (2,0, 1, -2), 3.9.4 2) 
~— IC 1, 1, 1), -1,=1,1, 1) ee 
a4: "a ; ‘ eas it 7 (1, 5, 1,8), (-1,7 — 
(i) x THY tx, — vectors in IR}, then i that 4 
are also linearly independ in IR? (i) x, x + WwXty+y, B 
24. Write (~ 4,7,9) as a - 


} 


yr 


Show that S is not 4 Spannin 


T the eler , 
8 set in IR? © elements of the set S: {(1, 2, 3), (- 1}; 3,4 


a ee x 
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26. 


27. 


28. 


29. 


30. 


Fae hk 
_ Write © + ¢+ 1 as a linear combination 
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of the elements of the set S: Bor — i fe Dp. 2}. Show 


7 ) all polynomials of degree 2 and can be taken as its basis. 
Let V be the set of all vectors in IR‘ and S be a subset of V 


(i) (x,.¥, —V, —¥), (ii) (x, 7,2, w) such that x+ yt+z—w=0 
(iii) (x, 0, 2, w), (iv) (Ww. x, x, x), 
Find the dimension and the basis of S. 


that S is the spanning set for 


consisting of all vectors of the form 


4 


For what values of k do the following set of vectors form a basis in IR° ? 
(i) {(A, 1 ~ A, A), (O, 3K — 1,2), (— k, 1, 0}, 
(ii) {(A, 1, 1), (0, 1, 1). (A, 0. 4D}, 
(iit) {(A, AL A). (O. AL A), (kK, 0, KY}, 
(iv) {(1, &, 5), (1, -3, 2), (2, -1, 1)}. 
Find the dimension and the basis for the vector space V, when V is the set of all 2 x 2 (1) real matrices 
(ii) symmetric matrices, (iii) skew-symmetric matrices, (iv) skew-Hermitian matrices. (v) real 


matrices A = (a,,) with a,, + aj, = 0, (vi) real matrices A = (a;,) with a), + a,, = 0. 


Find the dimension and the basis for the vector space V, when V is the set of all 3 x 3 (1) diagonal 
matrices (11) upper triangular matrices, (iii) lower triangular matrices. 


Find the dimension of the vector space V, when V is the set of all x 7 (i) real matrices, (ii) diagonal 
matrices, (111) Symmetric matrices (iv) skew-symmetric matrices. 


Examine whether the transformation 7 given in problems 31 to 35 is linear or not. If not linear, state why? 


31. 


‘ x . 
T:1IR- > IR': r{*) =x + y+ a, a #0, a real constant. 





Xx 


2 
32. T: IR? 3 IR? :T vil= ‘ } 33. T: IR' > IR’; T(x) = . } 
: ,ae FZ 3x fs 
: 0 x«#0,y40 x { 
34. T: IR? + IR! ; r{*) = 2y, x=0 35. T: IR? > IR'; Tl y | =xy tate. \ 
y 7 
3x, y=0. z 
Find ker(T) and ran(T) and their dimensions in problems 36 to 42. 
x x+) 2x+y 
r x 
36. Ts IR? SIR Thy} =] oz |. a1. 7 IR? 9 IRs T| |- y= 
; i 
- x-} 3x +4y 
‘a xtyt+w : 
3 : x 
38, T: IR? = IR?: T J ss 3 | 39. T: IR7° > IR': T | | =y+ 3y. 
z Py 
oat Pee 
iM yt+2w 
x 


41. T: IR? 3 IR*: T *) = 


r=—y 
y i= y | 


| 
ee, 


40. 7: IR? = ir! rl y| =x + 3y. 
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Yea 
re | 
at * 2e—F } 
be 42. TLR; GIRS T|)| * | ax4z. 
i.) z 
| eee x vey = 
‘ea | ened by TL] = 4° 
Lil | on defined i~<« 
he 43. Let T: IR? 2 IR? be a linear transformall z 
T with respect to the ordered basis 
Find the matrix representation of I \ 
1) (1) (9 | 
ra | ema | = Ss). & in IR*, 
= dohl iby lly in IR ane y {3} ? 
\7\ , 
ae . a linear transformation d ee 
44. Let V and IW’ be two vector spaces in IR?, Let T: VO W be a linear ation defined by ca 
ir 
* 0 Pe, 
| Tly|=| x+y |- | | | pe 
| z x+y+z | See 
| } 
| Find the matrix representation of T with respect to the ordered basis | 
7 : 1\ (0) (0 (1\ (1) (0 : 
| | x=dohfikjolsin v and y= O]] 1) ]1]) in © 
| | 0) (0) (1 1) \O)} \1 
| f | 45. Let V and W be two vector spaces in IR*?, Let 7: V 3 W be a linear transformation defined by F 
[ | . | 
i | 
| | x x+z 
| | Tly| = x+y |. | 
| * XE VEZ 1 





Find the matrix representation of 7 with respect to the ordered basis 


i 
i 
i 
} 
rT 
i 
+ 


~ 
> l cia ; 1}} in V and y= ~] , 1k —| in IV" ee 
46. Let T: IR? — IR* be a tic 2 x+y i 

© be a linear transformation defined by T po a 
yi es . rs 
oe x+2 qT 
Find : oe 0) 
ind the matrix representation of T with respect to th a, | : 

© ordered basis 

1) (1) fo | 
| x= 10h}, 1\ (1 
| YI Torta] in IR* 
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il 2 
-1R2 3 ; 
47. Let 7: IR" — IR° be a linear transformation. Let A - 2 3] be the matrix representation of the linear 
3 4 
transformation T with respect to the ordered basis vectors v, = [1, 2]’, v, = [3, 4]’ in IR? and 


ifs. Fi cee,” re. oe 
w, =(-l, 1, ow, = [l, -1, 1y" W, =[1, 1,—1]" in IR*. Then, determine the linear transformation T. 


1 2 


3 aA 
48. Let 7: IR° — IR° be a linear transformation. Let A = ; 3 \ be the matrix representation of 


the linear transformation with respect to the ordered basis vectors ¥ = fl, © f2,3) 7" 


3 47s, 1p} o Pes a : 
v,=[I, 1,-I]) in IR° and w, = [1, 1)’, w, = [2, 3]’ in IR’. Then, determine the linear transformation T. 


1 2 
Let 7: P,\(’) — P(t) be a linear transformation. Let A=| 2 31] be the matrix representation of the 
—| | 
linear transformation with respect to the ordered basis [I +2, 4 in Py) and [1 — 2, 21,2 + 32- t*] 
in P(t). Then, determine the linear transformation T. 


50. Let V be the set of all vectors of the form (x), Xp, X;) in IR? satisfying (i) x, — 3x, + 2x, = 0: 
(ii) 3x, — 2x, + x; = 0 and 4x, + 5x, = 0. Find the dimension and basis for V. 


49 


- 


3.4 Solution of General linear System of Equations 


In section 3.2.5, we have discussed the matrix method and the Cramer’s rule for solving a system 
of n equations in 7 unknowns, Ax = b. We assumed that the coefficient matrix A is non-singular, that 
is |A| # 0, or the rank of the matrix A is n. The matrix method requires evaluation of n* determinants 
each of order (7 — 1), to generate the cofactor matrix, and one determinant of order mn, whereas the K 
Cramer’s rule requires evaluation of (nm + 1) determinants each of order n. Since the evaluation of ’ 
high order determinants is very time consuming, these methods are not used for large values of n, 
say n > 4. In this section, we discuss a method for solving a general system of m equations in n 
unknowns, given by | ¥ 


Ax=b _ (3.28) 
Qj; Ayo «++ Aly | b, x) 
where AS @21 Qx2_ «+s 2g b= K x= X92 
Bj Gg tse Ay D,. Xi, 


are respectively called the coefficient matrix, right hand side column vector and the solution vector. 
The order of the matrices A, b, x are respectively m xn, m Xx | and n x I. 


The matrix 
a, a. .-» A, | O 
Ay, Gy «+ Gy b, (3.29) 
(A | 5) 2 ' ; , 
Ay) 49 nit Cig, bn 
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aaa Existence and Uniquenes 


\> Let V7, be a vector space consisting of n-tuple 
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3.42 Eng + 1) columns. The augmented matrix desert, 

| the system of equations (3,28) ;. be 
a 


e three possibilities: 


rows and (/ 
solution vector of 


e equations. There ar 


trix @ > 
is called the augmented marx and has vet 
completely the system of equations. a 
n-tuple (X), 2. + x,) that satisfies all | 


(i) the system has a u 
(ii) the system has no solution, 


(iii) the system has infinite num 


id to be consistent, if it has — 
d vector spaces, We NOW obtain the necessary an4 


ss of the solution of the linear system of 


nique solution, 


ber of solutions. 
atleast one solution and inconsistent, j¢; 
s is sa vif 
the concepts of ranks an 
the existence and uniquene 


The system of equation 
has no solution. Using 
sufficient conditions for 


equations. 

: ‘web Ton Joo C464 
ne s of the Solution | 
s in IR"(or C”). The row vectors Ry, Ry, .... R,, of the 
V,. Let S be the subspace of V,, generated by the row, 


m xn matrix A are n-tuples which belong to the s ce 0 
rix A and its dimension is called the row-rank of 4 


of A. Then, S is called the row-space of the mat 
and is denoted by rr(A). Therefore, 


row-rank of A= 1r(A) = dim (S). 


Similarly, we define the co/umn-space of A and the column-rank of A denoted by cr(A). 


(3.30) 


Since the row-space of m Xx n matrix A is generated by m row vectors of A, we have dim (S) <m 
and since S is a subspace of V,, we have dim (S) <n. Therefore, we have 


i 


rr (A)< min (m,n) and similarly cr(A) < min (7m, 1). (3.31) 


Theorem 3.6 Let A =(a,) be an m X n matrix. Then the row-rank and column-rank of A are same. 


Now, we state an important result which is known as the fundamental theorem of linear algebra. 


Theorem 3.7 The non-homogencous system of equations Ax = b, where A is an m Xn matrix, has 
a solution if and only if the matrix A and the augmented matrix (A | b) have the same rank. 


a ee — pi defined the rank of m X n matrix A in terms of the determinants of the 
neon : : ' . : : <n matrix has rank r if it has at least one square submatrix of order r which 
ingular and all square submatrices of order greater than r are singular. This approach is very 


time consuming when n is lar | 
1n is large. Now, we dis : 
mately. ’ cuss an alternative procedure to obtain the rank of a 


3.4.2 Elementary Row and Column Operation 
The following 


three Operations on a- , 
On a matri: 
4 rix A are called the elementary 


i) Interchange of any two 
(iil) Multiplication/division 
(iii) Adding/subtracting as 
that is @ multiples of 
of the ith row. The ele 
ith row get changed), 


row operations: 


rows (written as R, ~ R). 
of any row by 
calar multiple o 
the elements of 
ments of the jth 


“non-zero scalar (written as @R,) 

i ore another row (written as R, — R; + ak, 

aes are added to the corresponding elemen"® 
emain unchanged, whereas, the elements of th 
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These operations change the form of A but do not change the row-rank of A as they do not change 
the row-space of A. A matrix B is said to be row equivalent to a matrix A, if the matrix B 


can be obtained from the matrix A by a finite sequence of elementary row operations. Then, 
we usually write B = A. We observe that 





(i) every matrix is row equivalent to itself. 
(ii) if A is row equivalent to B, then B is row equivalent to A. 
(iii) if A is row equivalent to B and B is row equivalent to C, then A is row equivalent to C. 


the above operations performed on columns (that is column in place of row) are called elementary 
column operations. 


3.4.3 Echelon Form of a Matrix 


An m Xn matrix is called a row echelon matrix or in row echelon form if the number of zeros 
preceeding the first non-zero entry of a row increases row by row until a row having all zero entries 
(or no other elimination.is possible) is obtained. Therefore, a matrix is in row echelon form if the 


following are satisfied. 
(i) If the ith row contains all zeros, it is true for all subsequent rows. 


(ii) Ifa column contains a non-zero entry of any row, then every subsequent entry in this column 
is zero, that is, if the ith and (i + 1)th rows are both non-zero rows, then the initial non-zero 
entry of the (i + 1)th row appears in a later column than that of the ith row. 

(iii) Rows containing all zeros occur only after all non-zero rows. 


For example, the following matrices are in row echelon form. 


—— 


is 
1% 
i 
oe 
fd 
1 
iv 
7 
= 
. 
\y 


i234 
PaeMiatani nas : 
Ns 4 1,/6 © F SE. 4 al 
0009) [0 00 0J|, 0 4 \ 


Let A = (a;,) be a given m x n matrix. Assume that a,, # 0. If a,, = 0, we interchange the first row 
with some other row to make the element in the (1, 1) position as non-zero. Using elementary row 
operations, we reduce the matrix A to its row echelon form (elements of first column below a, are 
made zero, then elements in the second column below a2) are made zero and so on). 

Similarly, we define the column echelon form of a matrix. 


Rank of A| The number of non-zero rows in the row echelon form of a ma trix A gives the rank of 
the matrix A (that is, the dimension of the row-space of the matrix A) and the set of the non-zero 
tows in the row echelon form gives the basis of the row-space. 


Similar results hold for column echelon matrices. 
Remark 13 


(i) If A is a square matrix, then the row-echelon form is an upper triangular matrix and the 
column echelon form is a lower triangular matrix. 


7 —_ y 
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(ii) This approach can be used to examine whether a given set of vectors are ling 
or not. We form the matrix with each vector as its row (or column) and red 
(column) echelon form. The given vectors are linearly independent, if the , 
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arly ip 
C 
UCe if to Pete, 


ow e 
has no row with all its elements as zeros. The number of non-zero rows jg th, ie . 
the given set of vectors and the set of vectors consisting of the non-zero TOWs Seg of 
| 'S the 4... 
Example 3.25 Reduce the following matrices to row echelon form and find thei, rank ‘i 
ks 
-_ 1 2 3 4 
5 
als . . {2 1 4 = 5 
i —1 4), Hu 
( ; ae la ge 6 
2 8 1 14 17 


Solution Let the given matrix be denoted by A. We have 


5 

ji) A= 5 . si atins: ; 6|R.+2R 0 : : 
| | Ree OR, ee Tal 
3 @ 3 0 14 12 0 0 9g 


This is the row echelon form of A. Since the number of non-zero rows in the row echeloy 
form is 2, we get rank (A) = 2. 


12 3 4], ~ 1 2 3 4 1 2 3 4 

ws eel | + 3 gap wall “2 “2 “3 Reeee [a 

" ig 6 7/2? “ "lo 3 &@ 31k -5R, “l0 0 0 OT 
R, —8R, , 

8 1 14 17 O 15 ~ib <15 0 0 0 0 


Since the number of non-zero rows in the echelon form of A is 2, we get rank (A) wd 


Example 3.26 Reduce the following matrices to column echelon form and find their ranks. 


3 i ‘F | I -] l 
~|1 2 4 . {el 1 -3 -3 
(1) la 7P | (ii) ; oe 4 al 

4 -1 § 1 -l 3 3 


3 Ey 3 0 0] [3 0 0 
| } 2 41G-G/3 11 S/3 §/3 lt 5/3. 9 
(1) A = : ‘i C; = C.. —_ (0) 

4 =] TIC,-7C,/3 (4 -3/3 =7/3 2 14 -—7/3 

2  ¢ > Ws pa 27 1/3 0 
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Since the column echelon form of A has two non-zero columns, rank (A) = 2. 


1 1 -!1 y 


1 0 0 9Q | 00 0 
a | [ow ) 
(ii) A= Cy +c, = = ; 
1 O 1 —— lL -t 2 1| C,+C, 1 -1 0 O 
{=f 3 3,* ~“ [ ZF 4 8 il} 2 DD 


Since the column echelon form of A has 2 non-zero columns, rank (A) = 2. 


Example 3.27 Examine whether the following set of vectors is linearly independent. Find the 
dimension and the basis of the given set of vectors. 
(1) (1, Zi 3, 4), (2, 0, l, = 2), (3; 2D: 4, 2); 
(ii) (1, 1, 0, 1), (I, 1, 1, 1), G1, 1, 1, 1, G1, 0, 0, 1), 
(iii) (2, 3, 6, —3, 4), (4, 2, 12, —3, 6), (4, 10, 12, —9, 10). 
Solution Let each given vector represent a row of a matrix A. We reduce A to row echelon form. 


If all the rows of the echelon form have some non-zero elements, then the given set of vectors are 
linearly independent. 


L123 4),.5, [1 2 3 4 1 2 3 4 
(i) A=|2 0 1-2), 4, =|0 -4 -5 -10]/R;-R,=|0 -4 -5 -10]. 
924 3/7 * to 4 ~§ =p 0 0 0 0 


Since all the rows in the row echelon form of A are not non-zero, the given set of vectors 
are linearly dependent. Since the number of non-zero rows is 2, the dimension of the given 
set of vectors is 2. The basis can be taken as the set of vectors {(1 2 3 4), 


(0, —4, —3:5 —E0) }. é 
\ 
PIG, » |f 104 i101 
i a CP ENS oO o10), , ]9 2121,,,, 
Se) ee 5iL a le 6 4 op 
food * ™ (6 <i 0 9G 0-100 
11 01] 1101 
0212 Gea 2 
= R,-R,/2 = | 
rAin ” 0010 
0012 1 000 1 


Since all the rows in the row echelon form of A are non-zero, the given set of vectors are 
linearly independent and the dimension of the given set of vectors is 4, The set of vectors 


(1, 1, 0, 1), (0, 2, 1, 2), (0, 0, 1, 0), (0, 0, 0, 1)} or the given set itself forms the 
basis. 
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2 2 36-3 4 2 

2 3 6 ae : a a 

Gp as} FF 6) 1g Mee OF Oho ey 
41012 -9 0} © | [0 40-3 2 0 00 9 WF: 


Since all the rows in the echelon form of A are not non-zero, the given set of Ve 

linearly dependent. Since the number of non-zero rows Is 2, the dimension of the 

of vectors is 2 and its basis can be taken as the set {(2, 3, 6, -3, 4), (0,- 4, 9. 4 ey 
3.4.4 Gauss Elimination Method for Non-homogeneous Systems 


Consider a non-homogeneous system of m equations in n unknowns 


Ax =b (33) 
a) | a)\2 Qin by x) 
Qa, a a b» X> 
where A=| C2! 422 an | b= 2) x= 
Qni Fm? Amn 5m x), 


We assume that at least one element of b is not zero. We write the augmented matrix of order 
m X (n+ 1) as 


Qj, G2 «. Any |B 
a a .. a 

(A | b) = a 22 2n Ms 
Gu; Gin «ws Gy, 16, 


and reduce it to the row echelon form by using elementary row operations. We need a maximum of 
(m — 1) stages of eliminations to reduce the given augmented matrix to the equivalent row echelon 
form. This process may terminate at an earlier stage. We then have an equivalent system of the form 


Qj, Ap ** Ay ss Ay} 4 
O Gy ++ Gy, ++ Ay] by 
* ° : 3,33) 
(A | b) = 0 0 Se: S88 Bye b, l ( 
aS One Oem ® Ba 
0 O oO. 0| b, 
ases: 


where r S m and a,, # 0, @y, # 0, ... , a, # 0 are called pivots. We have the following © 


ClOrs ate | 
BIVEN sey 


util 
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(a) Let r <m and one or more of the 


(b) Let m 2 and r= 7n (the number of columns in A) and A- 


‘(c) Let r <a and — b 
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elements fh" 


: mits boxy ..., 5), are not zero. 
Then, rank (A) # rank (A | b) and the system 


Of equations has no solution. 
* * 
r+ty 5,49, ..., 6, are all zeros. 
his case, rank (A) = rank (A | b) = d the ati 
In t Se, 1 and the system of equations has a unique solution. 


We solve the nth equation for X,,, the (7 — 1)th equation for x, -, and so on. This procedure 
is called the back substitution method 


For example, if we have 10 equations in 5 variables, then the augmented matrix is of 
order 10 x 6. When rank (A) = rank (A | b) = 5, the system has a unique solution. 


a * 
r2+ +++5 6,, are all zeros, In this case, + unknowns, x), x, ..., x. can be 
determined in terms of the remaining (7 — 7) unknowns x --+ X, by solving the rth 


equation for x,, (r — 1)th equation for x,_; and so on. In this case, we obtain an 
(n — r) parameter family of solutions, that is infinitely many solutions. 


r+]> Xpaas - 


Remark 14 


(a) We do not, normally use column elementary operations in solving the 


(b) 


(c) 
(d 


— 


linear system of 
equations. When we interchange two columns, the order of the unknowns in the given system 


of equations is also changed. Keeping track of the order of unknowns is quite difficult. 
Gauss elimination method may be written as 


Elementary 


(A | b) —> (B |c). 


row operations 


The matrix B is the row echelon form of the matrix A and c is the new right hand side column 
vector. We obtain the solution vector (if it exists) using the back substitution method. 
If A is a square matrix of order n, then B is an upper triangular matrix of order n. 

Gauss elimination method can be used to solve p systems of the form Ax = b,, Ax =by,, ..., 
Ax =b, which have the same coefficient matrix but different right hand side column vectors. 
We form the augmented matrix as (A |b), bs, ..., b,), which has m rows and (71 + p) columns. 
Using the elementary row operations, we obtain the row equivalent system (B | ¢, C5, 
teey c,), where B is the row echelon form of A. Now, we solve the systems Bx = c), 
Bx =¢, ..., Bx = ¢,, using the back substitution method. 


Remark 14 


(a) 


(b) 


If at any stage of elimination, the pivot element becomes zero, then we interchange this row 
with any other row below it such that we obtain a non-zero pivot element. We normally 
choose the row such that the pivot element becomes largest in magnitude. 


For ann x 1 system, we require (#7 — |) stages of elimination. It is possible to compute the 
total number of additions, subtractions, multiplications and divisions. This number is called 
the operation count of the method. The operation count of the Gauss elimination method for 


solving an n xn system is n(n” + 3n — 1)/3. For large n, the operation count is approximately 
3p 
Ww/3, 
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3.48 Engineering Math 
ons (if possible) using Gauss gj, 
iming 


— ; of equat! 
Example 3.28 Solve the following systems iy 


method. 
eal 4 2 G Th jx 3 
yt =I /x : . a Nec 
i ; 211 ¥ = |-2}, (it) | ape sli 
Gy] tal <i 5 4. ~Q’ S)1z 3 
-) 2 -ljL4J 
pat Tile Ct 
(ii) {2 1 -TYI2 =|2]. 
5 


5 —2 2)/4 
Solution We write the augmented matrix and reduce it to row echelon form by applying clementay 


row operations. 
| =|) 4 


2 1-i| 4 2 
jy (AL By=| 1b -2 24>? R,-Rl2 |g -3/2-  5/2|—4) Rs + 582 
™ 2 
4 geil 2 R,+R/2 1g 5/2 -3/2) 4 
» 1 -i 4 


go -3/2 5/2) —4'. 
0 0 8/3|-8/3 


u 


Using the back substitution method, we obtain the solution as 


8 


=—-—, OF g=-l, 


8 
3° 3 


— 


2 
xty-z=4, oO x= un 
stem of equations has the unique solution x @ 1. = 1+ 


_— 


By 422 =-_4 or y=l, 


2.2), 


Therefore, the sy 
j 
, : , | 
a @ ys 2 O 
(i) (A[D)=]1 —-1 VWI), =lo -1 1/2}—1/2| Ry-2R2=|° ~ 
R, —2R, = 0 ae 
4 -2 3)3 gj —2 a aes go 0 
| gst! 
We find that rank (A) = 2 and rank (A | b) = 3. Therefore, the system © equatiom 
solution. | 
1-1 | rat wi pat! 
. , R, -2R, 
Giiy (AI DY=|2 1-2/2 _ gp = [0 « <al6l R= Rew] 3 -3/° 
R, —5R, +1 453 2 0 


A 
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nsistent and has infinite number of solutions. We find that the last equation 
—_ 32 = 0, Or Bs = F, 


btain the solution 


The system is co 
is satisfied for all values of x, y, z. From the second equation, we get jy 
From the first equation, we getx —-y +z = 1, or x = 1. Therefore, we 0 
x= 1 y=? and z is arbitrary. 


ple 3.29 Solve the following system of equations using Gauss elimination method. 


Exam 
(i) jy = Sy = 92 + Ow = 0 (ii) x+2y-2z=I1 
ox + 3y + 32 + bw = 6 2x —3y +z =0 
Ax —21y _ 397 — 6w = —24, 5x t+ y-—5z = 1 
3x + 14y — 12z= 5. 


on We have 


Soluti 
4 -3 -9 6 l,.6 2 = _9 6| O 
jy alb=|2 3 3 8 : 2 7(° 92 8 3] 6|R, +42, 
ee ee ee ee -24 


4 -3 -9 6|0 
0 9/2 15/2 3] 6}. 
0 oO 0 0} 0| 


is consistent and has infinite number of solutions. Choose w as 


d equation, we obtain - 
¢ 


| l 
2(¢—aw—B2}=5 -S2- 20) \3 
2 3 ly 


The system of equations 
arbitrary. From the secon 


9 15 
2p +—s7=6-3w, Or Y= 
ae. 


From the first equation, we obtain 

Ax = 3y + 92 - 
x= 1t+z-2w. 

parameter family of solutions 


Sy = Sx— Dw + 92—-6wed + Az Bw i 


or 
Thus, we obtain a two 


x=l]+z-2w and y = (4-52 — 2wy/3 
where z and w are arbitrary. 
» 2 -2(1 1 gg] | 
5: Sh we R,-2R, |y ~7 5|-2]R:-9R/7 
MYAVE) Fle 3 3/1 a =|) ~9 51-4] Ry +8R/7 
13 14 -12|5 Ry-?™ 1g 8-6] 2 
1 2 -2 1 2 -2 
«4 0 =7 s| =2 
-\5 0 Ry~ Bie * 10/7 |" 
9 0 —10/7| - 10/7) 0 0 -10/7|- 
le 6 =2/7| 2h! 0 0 0 0 
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3.50 Engineerin g Mathematics 


The last equation is satisfied for all values of x, y, z. From the third equation " 
Back substitution gives y = 1, x = 1. Hence, the system of equation has a yp; ies fain 2 
y= 1 and z= 1. Since R, = (24R, — 7R, + R3)/5, the last equation is redundant ration a) 


3.4.5  Gauss-Jordan Method 


In this method. we perform elementary row transformations on the augmented Matrix [A | p 


is A Square matrix, and reduce it to the form : ete 4 


[A b] Elementary (I | c] 


row operations 


Where I is the identity matrix and ¢ is the solution vector. This reduction is Equivalent to F. 
the solution as x = A™' b. The first step is same as in the Gauss elimination method. From tind 
onwards, we make elements below and above the pivot as zeros, using elementary row transformay, 
Finally, we divide each row by its pivot to obtain the form [I | c]. Alternately, at every Step, the “a 
can be made as | before elimination. Then, c is the solution vector. ‘ 

This method is more expensive (larger operation count) than the Gauss elimination. Hence. We dy 
not normally use the Gauss-Jordan method form finding the solution of a system. However, this meth 
is very useful for finding the inverse (A~') of a matrix A. We consider the augmented matrix [Al I] and 
reduce it to the form 


[AI AY 


using elementary row transformations. If we are solving the system of equations (3.28), then we have 
x =A” b, and the matrix multiplication in the right hand side gives the solution vector. 


Remark 16 


If any pivot element at any stage of elimination becomes zero, then we interchange rows as in the Gauss 


elimination method. 


Example 3.30 Using the Gauss-Jordan method, solve the system of equation A x = b, where 


Por 
=) 1 -l 1 0 
A=/|2 1 -3]|, and b=/4 

1 1 1 


itt 
Solution We perform elementary row transformations on the augmented matrix and f 


form [I | C]. We get 


1-1 10), 4, [1 -1 1/0 
[Alb]=|2 1 314) 2 “'2lq 3 -sl4/R,/3 
] 1 1}] 0 2 Ol 


dl 
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at 


=] l 


0) 
=10 1 —5/3| 4/3 


Rar, |! 9 -2/3| 4/3 
2 |_| 22 


={0 1 -5/3] 4/3] R,/(10/3) 
0 0 10/3|-$/3 


i) 


1 0 -—2/3| 4/3] 


| 1 0 0 i 
=|Y 1 S73) 473 ‘hie 0 1 0} 1/2 
0 0 R, +5R,/3 | 
1} -1/2 O 0 I) =178 
Hence, the solution vector is / | 
x=[l 1/2 -1/2]7. 
. —| 1 2] 
Example 3.31 Using Gauss-Jordan method, find the inverse of the matix A = 3 -| | 
yo . -| 34 
Solution We have 
=] 1217 0 0 
(A|I)=] 3 -1 1/0 1 Ol. 
-l 3 4/0 0 1 


Dee Bak a { =f =2/-1'0 0 
AID=| 3-1 1] O 10/2 o'=]0 2 7) 3.1 Of Rv 
~—{ & ££) G0” * OB Bot @ 1 
iot +2)+1 50), _. 1 0 3/2/1/2 1/2 0 
=|0 1 7/2)3/2 1/2 0 iene =|0 1 7/2/3/2 1/2 O| (-R,)/S 
0 2 #2/-1 o01}/% 7 |o 0 -s}-4 -1 1 
1 0 3/2{1/2 1/2 |. sam | 0 0] —7/10 2/10 3/10 
={0 1 7/2|3/2 3/2 0 4 ee 0 1 O|-13/10 -2/10 7/10}. 
O60 tla ws =)"  * 00 1, 4/5 WS -1/5 
ay @ 3 
Hence, i= Slay 2 7 
Wl gg g = 
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1 a Vit alti ‘quations 
Rhu 3.4.6 Homogeneous System of Linear Eq 

syste 





m of equations 







| 

, yc 

| Consider the homogencous | (3.34 
(4) Ax = 0 , 
| | nh m is always consistent since x = 0( 
i wi i 
j f 
| 






5 syste 

The homogenous Sy" ‘therefore, for the h 
In this case, rank (A) = rank (A Me © homog 
on, we require 
form a ve 


: - Neoy. | 
that rank (A) < 7. If rank (A) =r <n, We be 
ctor space of dimension (1 — ) ag (ny 





| | where A is an mi * 1 matrix. 
bid tite solution) is always 4 solution. 
Bigs system to have a non-trivial solut! y SS oe 
: he , an (n — r) parameter family of solutions 













. “1, 
eae sen arbitrarily. — 
an parameters can be cho ‘< called the null space and its dimension is ¢4 
at . | eneous system 1S Calle leg 
an The solution space of the homoge" "2 = 

| e solution space Of 

RS atigsat A Tere, we oan thers vem 35) 

ni a rank (A) + nullity (A) =» (see Theorem 3-5). 

& | | 

Tat Remark 17. 

Pi | (a) If x, and x, are two solutions of a linear homogeneous system; then @&Xx, + Bx, is also, 
1 ’ 

! | | solution of the homogenous system for any scalars @, B. This result does not hold for 
: it non-homogenous systems. 

) | (b) A homogeneous system of _m equations_in_m_ Owns always p $a (iii) (4 
in non-trivial solution, aa 
i} 1 : , 
ah ' : 3.8 Ifanon-homogeneous system of linear equations Ax = b has solutions, then all these 

im i; 5 « « . . : 

7 ' solutions are of the form x = X + x, where XQ is any fixed solution of Ax = b and x, is any solution T 
| : of the corresponding homogeneous system. a fe 
hi - : ; | ; a 
, | Proof Let x be any solution and xy be any fixed solution of Ax = b, Therefore, we have 
iat | 
| | | en aan Se Exercise 
ial Subtracting, we get gh 
| | Using the 
| | Ax — Ax, = 0, or A(x — Xp) = 0. 

] | Thus, the difference x — x, betwe os ee | 

| | | Ax = b is a solution of the hatin Be! solution x of Ax = b and any fixed solution %p of 

ids | ous system Ax = 0, say x,. Hence, the result. 

iat Remark 18 , 

\! 

gat If the non-homogeneor 
ay ! eneous system Ax = b wh , 
1a ere , , re 
Et that is rank (A) =n, then the corresponding ho Als an m x n matrix (m > n) has a unique solulio! 
| that is x, = 0. | mogeneous system Ax = 0 has only the trivial soluttor 4, | 
i Exampl | 

it ple 3.32 Solve the followi 
- | OW 
i | Ing homogeneous system 0 
| Gil «< e - 
| . ” I, (ii)}1 . 
: 13 ? ) 


Find the rank (A) and nullity (A) 
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‘on We write the augmented matrix (A | 0) and reduce it to row echelon form. 


golut! 
: 1 R-Ri2 |* se 2 1/0 
(i) (ALO Pe —3R,/2 ~ [9 ~3/2]0] R+R/3 =]0 -3/2/0] 
3 2/0 QO 1/2 0 0 010 


Since, rank (A) = 2 = number of unknowns, the system has only a trivial solution. 
Hence, nullity (A) = 


p22 -3/0), | 2 -3]0 i 2 +3/0 

‘2 
(ji) ALO=]E 1 -10F 0 | =/o -1 2/0/z,-32, =/0 -1 2/0). 
1-1 0; * “' [0 -3 4lo 0 0 -2/0 


Since rank (A) = 3 = number of — the homogeneous system has only a trivial 
solution. Therefore, nullity (A) = 


bid WO, os i 1-1 1/0 i i =3 a6 
(iii) (A|0)=]2 3 Le ee, 0 1 3 2{0]R,+R, ~{0 1 3 2/0 
32-6 flo|” ~* lo +1 =3 —Blho 00 O Oo 


Therefore, rank (A) = 2 and the number of unknowns is 4. Hence, we obtain a two parameter 


tthf f fas 


family of solutions as x, = —3x, —2x,4, x) =— xX, + x; — x4 = 4x, + x4, where x, and x, are 
arbitrary. Therefore, nullity (A) = 2. 
IY 
Exercise 3,3 \2 
ly 
Using the elementary row operations, determine the ranks of the following matrices. \ 
20 -!l 1 —-2 3 2 1 -2 
js | 2% |2 LL ZL 3. |-l -1l IJ. 
01 3 -5 II 3.06UC«ds = 
) LE 2 J 
; ~| 6- lL -2 l- 1 3 4 
23 4 5). elt a 3 a | 
! - , xz 
4-13 =5 at Ls 8 13 14 
[23 ¢ 2a 2 9 =! 0 
71/2 3 4 5§ o jet ft == , [ee OS] 
7 Ws jot ". Bat 01 3 6 
> AS Qh a7 rio | 6 | -2 6 
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7 3 ¥ O 4 
3 KZ =I a 
1 ly af 9-2-2 
Ee ee ac the rank of the following matrices. 
un ations, determine Pr © 
Using the elementary column operdt e ea . , . 
fo -l] 2. | 3 -! I} 13. | 7 i} 
wu. {1 oO | nr 
1 -| 3 
| 2 4 og 0 * 
i 9 FRE Ly 
14. ‘ i i |) oy 3-2 -2 
4 a 5 
§ 4,3 5 4 3 l 


Determine whether the following set of vectors is linearly independent. Find also its dimension. 


17. {(2, 2, 1), C1, -I, 1), (10,1), 
19. {(2, 2, 1), (2, i, -1), (1 + i, iM), 


16. {(3, 2, 4), (1, 0, 2), (1, -1, -)}- 

18. {(2, 1, 0), (1, -1, 1), (4, 1, 2), (2, -3, 3)}- 

20. 10, 1,1, 49, (+ i -1 -i, 2} 

21. {(1, 1, 1,1), Gl, 1, 1, -1), (1, 0-1, 1), (1, 1, 0,1)}. 
@ {1.23.1 @.1.21-16.S, §3)3.:6..% 1, 3}. 
23. {(1, 2, 3, 4), (0, 1, -1, 2), (1, 4, 1, 8), G, 7, 8, 14)}. 
24. {(1, 1,0, 1), (1, 1, 15 1), (4, 4, 1, 1), (1, 0, 0, 19}. 
25. {(2, 2, 0, 2), (4, 1, 4, 1), (3, 0, 4, 0)}. 


Determine which of the following systems are consistent and find all the solutions for the consistent sys | 


26 i ale 7 V4 ix) ft 1 -4 7][x] |8 
"Ty. tealleh lal oT 12S 8ilyt=|2). 28. |3 8 -2/|»]=/°} 
1 | 
29. |3 -9 2 i a : 11 [x 7 > OQ —-3lIx 
5 -3 4 i : a) ae 3 YI=] 16). 31 G4 =3//7/= 0 
is | 3 4 Bs 22 | a | is | 
5 3 14 4 | 
fs 
32, (9 Ft tn |. =? 1 271/* al? ‘4 
l ] ? |= 0 . 33 i | | , y | l I y . a\. 
: =|2|. 3 = A 
WwW | —| ] -1] Ww 








] 
45, |? 
3 
4 
Using the G: 
ft 
46, || 
] 
1 
49, |~1 
~| 
] 
35. 
rt Rig, 
tA 
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a 
Lm 
\ 
| 
— a 
= tt ‘— 
o 3° Ss — 


ad all the solutions of the following homogeneous systems Ax = 0, where A is given as the following. 
Fi 


1 2 Qi » . @ 3 -I) 5 

y. |! -2 3} 37.) 3 4 -71. 38. 14. 1 -10 
1 § =4 -l -2 1] 4 6 6 

- 4 =f sy i Pe? ow f 
i wo (io i ot y |i rit 

39. |1 1 | j o =? = =i! oe =f } oF 
126 te 6 8 1 iia 4 
31 14 Ll t 4 2 i «BP ¥ ad 
04 10 1 % .f -2 -3 i { =% 4 

43 44. 

1) 7 17 3 3 0 -5 -1 4 4% 8 
22 43 q =f =f <4 5-7 2-1 
i Pg 

gfii- 

"ty > =f 3 
422-4 


Using the Gauss-Jordan method, find the inverses of the following matrices. 


i {e239 1-1 1 1 
4.11 2 3]. 47. |1 3 (re ee 
has a boa ode 
Proud cias 
: 1 
git i ks “. 
“I-14 4 4411 
1001 


35 Eigenvalue Problems 


Let 4 = (a,) be a square matrix of order n. The matrix A may be singular or non-singular. Consider 


th : 
* homogeneous system of equations 


Ax=Ax or (A- AI) x =0 (3.35) 
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cin : | Sum of eigenvalues — . 
a} | . Se 7 Product of ej 
: ene eigeny 
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3.56 Engineering Mathematics 
n. The homogeneous system of Sie 


; r which the homoge 
- in} olution. We need to find valu an ® fel solutions of the one = 
(3.35) always has a trivial so” The values of A for which non-tr f A and th a 
(3.35) has non-trivial anne’ ‘saevalues OF the characteristic values of A and the CorTespo 
t, are called the ef 


{ 

| a eix of order 
Where A is a scalar and I is an identity matrix © 

| 

| r the characteristic values of A. If 


system (3.35) exis -d the eigenvalues oO X js 
| a non-trivial solution vector x are nag? 35), then OX, where @ is any constant 1s also a solution a 
| ) non-trival of the homogencous ee s veciat ig unique only upto a constant multiple. The Probe | 
i : the homogeneous system. Hence, an ig ding eigenvector of a square matnx A is calleq 
fii of determining the eigenvalues and the correspon an 
r | eigenvalues problem. 
tt tan ‘i and Eigenvectors 
3.5.1 Eigenvalues an 4 , , 
r _ swial solution, then the rank of the coefficient mar 
} | If the homogeneous system (3.35) has a non trivial solu . sinoular. Therefore = 
| | i | (A — Al) is less than n, that is the coefficient matrix eigen 
| | i | “ais | <) a ¥) ; ayy A a)4 Saty Qin 
eat + IRIZ o ) »-A ss a 
i . det(A-a =| “  1=0. aa 
f H . ose 
1 
if Expanding the determinant given in Eq. (3.36), we obtain a polynomial of degree n in A, which is of 
at the form 
i P,(A) = 1A — ALL = (-1)" [A" cy, @"") + cA"? — ... + (-1)"c,] = 0 
if | or HAM cA + 0A" - ... + C1)", =0. (3.31) 
| : Where c,, Cree Cy CaN be expressed in terms of the elements a;; of the matrix A. This equation is called 
| ! “i neg equation of the matrix A. The polynomial equation P,, (A) = 0 has n roots W ae 
| i | “a = ae ao . repeated. The roots Aj, Ay, ..., A, of the polynomial equation P,(A)= 
wiB | genvalues. Dy using the relation between the roots and the coefficients, We cam ¥™* 
| 
| K MF Me ct WO AG tithe + ea, 
h! : "] 
, . + Miho + Aydy + 0+ Any Ay = C5 
! 
[} ae : 
| Ay Ag +1 Ay = Cy gs 


| If we set A= 0 in Eg. (3.36), then we get 


lA] = (-1)"c, — 


n= AA)... A, 


Therefore, we get 










alues = |Al. | 






ning | 
























Ther 
succt 


3. A- 


‘or 
4 AT 
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t of the, eigenvalues _ is called the spectrum of A and the largest eigenvalue in magnitude 1s 
the spectral radius of A and is denoted by p (A). If |A| = 0, that is the martix is singular, then 
“Eq. (3.38), we find that atleast one of the eigenvalues must be zero. Conversely, if one of the 

is zero, then |A| = 0. Note that if A is a diagonal or an upper triangular or a lower 
matrix, then the diagonal elements of the matrix A are the eigenvalues of A. nF 


The set 

called the 
from Eq. 
eigenvalues 








rriangular mn 
epee the eigenvalues A,’s, we solve the homogeneous system (A — A, I)x = 0 for cea 
_n to obtain the corresponding eigenvectors. 






Afte 
ne Ls dy * 


properties of eigenvalues and eigenvectors 


Let A be an eigenvalue of A and x be its corresponding eigenvector. Then, we have the following 
results. 
1. aA has eigenvalue aA and the corresponding eigenvector is x. 
Ax =Ax=> a Ax = (QA)x. 
2. A” has eigenvalue 2” and the corresponding eigenvector is x for any positive interger m. 
Pre-multiplying both sides of Ax = Ax by A, we get 
A Ax = Adx = AAx = A(Ax) or A’x = A’x. 
Therefore, A? has the eigenvalue A° and the corresponding eigenvector is x. Pre-multiplying 
successively m times, we obtain the result. 
3. A— KI has the eigenvalue A — k, for any scalar k and the sefeianedlithy eigenvector is X. 
Ax=Ax>Ax-—kIx=Ax-kx 
or (A — k1)x= (A - k)x. 
4. A''(if it exists) has the eigenvalue 1/A and the corresponding eigenvector is xX. 
Pre-multiplying both sides of Ax = Ax by A”', we get 
A'Ax =AA'x or A'x = (A)x. 
5. (A - kI)"' has the eigenvalue 1/(A — 4) and the corresponding eigenvector is x for any 
scalar k. 
6. A and A’ have the same eigenvalues (since a determinant can be expanded by rows or by 
columns) but different eigenvectors, (see Example 3.41). 


7. For a real matrix A, if a+ iB is an eigenvalue, then its conjugate @ — iB is also an eigenvalue 
(since the characteristic equation has real coefficients). When the 1 matrix A is complex, this 


property does not hold. AR snE 


We now present an important result which gives the relationship of a matrix A and its characteristic 
€quation. 


Theorem 3.9 (Cayley-Hamilton theorem) Every square matrix A satisfies its own characteristic 
“uation 


A" = cA"! # - a | C,.1 A rs lV C, I = 0. (3.39) 





Scanned by CamScanner 


Oe 





ee — = 


i ll es ET SS = 





_, 


3.58 Engineering Mathematics 


Proof The cofactors of the elements of the determinant |A — AI| are polynomials ; In Ao 

(1 — 1) or less. Therefore, the elements of the adjoint matrix (transpose of the Cofactor js deg, 
also polynomials in A of degree (1 — 1) or less. Hence, we can express the adjoin Rie at 
polynomial in A whose coefficients B,, B2, .... B,, are square matrices of order ny havin ‘& 
as functions of the elements of the matrix A. Thus, we can write Se “lemon, 


adj(A — Al)=B,A"!+B,A"? +... + B,_,A + B,, 
We also have 


(A — Al) adj (A-AD=|A-AII 
Therefore, we can write for any A 
(A — Al) (B,A""' + BLA"? +... + B,_;A + B,) 
=A -—¢ AT 1+ ... + G1)" c,.; AL+ G1)" ¢,1 


Comparing the coefficients of various powers of A, we obtain 


— B, = 
AB, — B,= cI 
AB, — B, = c5l 


AB,_, — B, = C1)" ¢,_11 
AB, = (-1)" c, I. 
Pre-multiplying these equations by A", A"~', ..., A, I respectively and adding, we get 
A"—c, A"! +... + (-1)"'c,_, A + (-1)"c, I = 0 
which proves the theorem. 
Remark 19 
(a) We can use Eq. (3.39) to find A”! (if it exists) in terms of the powers of the matrix A 
Pre-multiplying both sides in Eq. (3.39) by A7', we get 
AA" —c, ATA™! +... + C1) 'c,_, ATA + (-1)"c, ATE = Ao'0 = 0 


| n ; (3.40) 
or A'=- Cy [A”'-—¢, A"? + as +(-1;""' c, 11] 
Ch 
(b) We can use Eq.(3.39) to obtain A” in terms of lower powers of A as gal 


A" = c,A" | = eA" me oak vs (=])" lo I. 


Example 3.33 Verify Cayley-Hamilton theorem for the martrix 


1 2 0 
A=i/-l I 2). 
12 1] 


A 
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_ pol 3 73: : : 
j) obtain A” and A’, (ii) find eigenvalues of A, A° and verify that eigenvalues of A’ are 


if os 
Also of those of A, (111) find the spectral radius of A. 


squares 
colution The characteristic equation of A is given by 


1-A 2 0 | 
JA-AN=| -1 I-A 2} =(1-a) (1 -AP- 45-2 EF -A)-2) 
l 2 1-A 
= (1 — A) (A? - 2A - 3) -2(- 3) = - V+ 30-14 3=0. 
12 0lf 12 oO] [-1 4 4 
Now, A?7=|-1 1 2/|-1 1 2/=| 0 3 4 
12 11] 12 1 0 
14 417 12 oO| J-1 10 12 
A? =A’A=| 0 J | =| 1 Ti 20}: 
s|| 1 2 1 -1 16 17 
We have 
=] 10 14 4 i 2 Qo [1 0 0 
_a343A27-A+31=-]| 1 11 10} +3) 0 s-a)—|-L 1 2/)+#3/0 1 8 
-_1 16 17 0 6 5 1 2 4 001 I 
00 0 ie | 
-190 0 O|=0. (3.42) Ap 
0 0 0 N 
Hence, A satisfies the characteristic equation — a4 3 a A+ 3 = 0. 
(i) From Eq. (3.42), we get 
‘5 4 4 3 6 0) (1 9 0 jet A 
te) ge s lig a gl4lo 4 Oll=s| 3 tb =4} 
A =—[A*-3A+I]) =< 0 3 4 3 3 
: 3 ilo 6 5 3 6 3) \o O | —j 0 3 
From Eq. (3.42), we get 
% 42) i 1 2 0] [3 0 0 | {6 42 
O~942 geap=| 0 9 12[-}-? 1 2/+|0.3 O}=] } ?! 10 
0 18 15] 12 1) |0 0 3 «|; 16. 4% 
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| (ii) Eigenvalues of A are the roots of 
Theis a3 _ 9924-3 = 0 or A—3)4° + =O Or A= 3,5 -7 
my ia! : The characteristic equation of A? is given by 


HBL! -l-A 4 4 | | 
Sigees 4 =(-1-A [3-4 (5-4) - 24] = 0 


ig 0 3-A 
tg | to 0 6 5-A 
a | or (A+ 1) (A2-8A-9)=0 or (At 1) (A-9) At I= 0. 


The eigenvalues of A* are 9, — 1, — 1 which are the squares of the eigenvalues of 4 


at (iii) The spectral radius of A is given by 
ii p (A) = largest eigenvalue in magnitude = max |A,| = 3. 


1 0 0 
Example 3.34 If A=|]1 0 1], then show that A" = A"-? + A? —I for n = 3. Hence, find 4® 
tt 0 1 0 | 
ai 
| Solution The characteristic equation of A is given by 
a 
_ 1-A O 0O 
ay AK AT|= 1—-A 1i/=(-AGQ?2-1)=0, or V-A-At1=0 
| 0 1-A 
| Using Cayley-Hamilton theorem, we get 
i 4 
| A>-A?-A+I1=0, or AX-A?=A-T, 
: Pre-multiplying both sides successively by A, we obtain 
7 Ae AR] 
oF | MAS At A 
: i } AN! = A" - = A’-3 _ A" 


A" be Al! = A"? _ A 
Adding these equations, we get 
A" ire A- = A’? ” L, or A” — A"? +- A; is I, il = 3. 


Using this equation recursively, we get 
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A" = (A"4 + A? -1) + A? - 1 = A + 2(A? - 1) 


5 


= (A" G4 A? -_ 1) + 2(A* 1) - A” O 4 3(A2 — 1) 


| i nN , | 
= atl 4 2 Cn — 2) (A? - 1) = = A = (2 - 201. 
5 (ni ) ( 1s 5 
cpstinuting # = 50, we Bet 
1 0 0 1 0 0 1 0 0 
A™ = 25A? -241 =25]1 1 O}-24/0 1 O}=|25 1 O}. 
1 0 1 ) 2 1 25 0 1 
example 3. 35 Find the eigenvalues and the corresponding eigenvectors of the following matrices. 
4 7 1 0 0 
l . aoe 
(i) A -| | (1) A = ‘ (G)A=|}0 2 I}. 
o 4] 2 0 3 
Solution 
(i) The characteristic equation of A is given by 
see Ae A 0 =— 2,5 
|A-AI|= 32-4 =0 or A“-3A-10 =0, or A=-2, 5. 





Corresponding to the eigenvalue A = —2, we have 


3. 4)\/ x, 0 4 
‘A + = = r 3x, + 4x, = 0 x, =- —%X. 
(A +21) x i ‘ i or x x3 or x, 3 X> 


Hence, the eigenvector x is given by 


_ ial 7 ee _. f-473 
x= = ~ ag | 
X9 ey | ] 


Since an eigenvector is unique upto a constant multiple, we can take the eigenvector as [- 4, 3]” 


Corresponding to the eigenvalue A = 5, we have 


(A —- 5] = i | i mi or x, —X, = 0, orx, =x 
)x= 3 =. x) \0 |) “9 , | “Fe 


Therefore, the eigenvalue is given by x = (x), 42)’ = x,(1, 1)’ or (1, 1)’. 


(li) 
The Characteristic equation of A is given by 


-A I 


ae | 
Aa | ~t La 


= 0 or Aes 9442 = 6, or A=1 4i. 
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; we have 
- = |]t+i, we 
Corresponding to the eigenvalue A 


; | ! | ; ‘ A > 
rA-(1+)1)X=1_y =i] mJ Le F: 
+ xy = and — x) ~ 2 = 9 tee ae 


— 1x 
: = (0. Choosing *2 ~ 1, we get x; = -t. Therefore he 


or 

— x, — 1x 
Both the equations reduce to — XY 2 
eigenvector Is X = [-i, I] - 


Corresponding to the eigenvalue A = 


i fx] _]9] 
[A — (] = HL x= * i ial ~ A 


0. 


= | —i,-we have 









soution 


i itisim mpk a 


ix; tx = 0 and — x, + IX, = 
= (), Choosing x, = 1, we get x, = i. Therefore, the eigenvecty 


or 





Both the equations reduce to —x, + 1X2 = 
is x = [i, 1)’. 

Remark 20 

For a real matrix A, the eigenvalues and the corresponding eigenvectors can be complex. 


(iii) The characteristic equation of A is given by 


I-AO oO 
|A-AI]/=/| 0 2-aA 1 /=0 or (1-4) 2-AG=-A=0 or A=1,2,3. 
2 0 3-A 


Corresponding to the eigenvalue 2 = 1, we-have 


(A-Ix=]0 1 Illy, |lol or f + x, =0 
20 2 xX 0 Xx; =0° 


We obtain t 
atiracil fas Equations in three unknowns, One of the variables x,, x5, x, can be chose" 
y. a Ing ty = l, we obtain the ei | “Sia <}34 - 3 
Eenvector as [-1, =|. iy 


Corresponding to the eigenvalue 4 = 


= 2, we have 
—] Q) 0 | x | 
(A -21)y = 00 | 7 _ 7 (ij) 
| =O 4 *3 0 
or x, =0,%.=O0O8 “i 
PA Boks * Ocand x, arbitrary. Taking i. = ay. | Ti. 
*2= 1, we obtain the eigenvector as [0, I Th 
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Corresponding to the eigenvalue Q = 3, we have 
=2' 0 0 x, ||0 
(A —- 31)x= 0 1 hx ilo or a= 
20 IIx, lo ie ies 


Choosing x; = 1, we obtain the eigenvector as if 6.4 17 
Example 3.36 Find the eigenvalues and the corresponding eigenvectors of the following matrices 
0 
] 
] 


1 | 
(i)A={0 1 
0 0 


1 1 0 100 
(ii)A=|0 1 Ol. (iii) A=|0 1 Ol. 
00 1 001 


Solution In each of the above problems, we obtain the characteristic equation as (1 - A) = 0, 
Therefore, the eigenvalues are A= 1, 1, 1, a repeated value. Since a 3 x 3 matrix has 3 eigenvalues 


it is important to Know, whether the given matrix has 3 linearly independent eigenvectors, or it has 
“|esser number of linearly independent eigenvectors 


Cormesponding to the eigenvalue A = 1, we obtain the following eigenvectors. 


0 1 0 0 X» =0 
(i) (A-I)x=|0 0 1|x=|0] or x,;=0 f 
00 0) lo)’ |x, arbitrary. h 


Choosing x, = 1, we obtain the solution as [1, 0, 0]7. 


Hence, A has only one independent eigenvector. — | 


0 ] 0 x) 0 | De Lf t 
“* x, =0 ah eal AEA 
")  (A-I)x=]0 0 O|}x,}/=/0], or 


x,, X, arbitrary. 
0 0 O||x;} {0 —* 


Taking x, = 0, x, = 1 and x, = 1, x; = 0, we obtain two linearly independent solutions 
x, =[0, 0,1)", x, =[1, 0, o]’. 


In this case A: has two linearly independent eigenvectors. 


ai) (A-—1)x=|]0 0 O0||x, {=| 0}. 
0 0 OF] %5 0] 
This system is satisfied for arbitrary values of all the three variables. Hence, we obtain three 


linearly independent eigenvectors, which can be taken as 
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x, =[1, 0, 0) ¥2 = (0, 1,0), x5 = [0, 0, 197 


sults regarding the relationship between the eigenvalues : 


We now state some important re f 
Fo. He igenvectors. 4 May, 
and the corresponding linearly independent e1g at 
A 1. Eigenvectors corresponding to distinct eigenvalues are linearly independent. 
*2, If A is an eigenvalue of multiplicity 2 of a SUAKS mann A of order n, then the num 
d with A is given by berg 


_. linearly independent eigenvectors associate 


p=n- I where r= rank (A - Al), I< PSm. 


Remark 21 

In Example 3.35, all the eigenvalues are distinct and therefore, the corresponding Cigenvecton | 

linearly indenpendent. In Example 3.36, the eigenvalue A = | is of multiplicity 3. We fing that 
(i) Example 3.36(i), the rank of the matrix A — I is 2 and we obtain one linearly Independey 


eigenvector. | | | 
(ii) Example 3.36(ii), the rank of the matrix A — I is | and we obtain two linearly independs 


eigenvectors. | | 
(iii) Example 3.36(iii), the rank of the matrix A —I is 0 and we obtain three linearly independ 


eigenvectors. 


3.5.2 Similar and Diagonalizable Matrices 


Similar matrices 
Let A and B be square matrices of the same order. The matrix A is said to be similar to the mam 


B if there exists an invertible matrix P such that 


A=P'BP or PA=BP. m 

Post-multiplying both sides in Eq. (3.43) by P-', we get 
PAP '=B. : | 
to A. The matrix P is called the sia 


Therefore, A is similar to B if and only if B is similar 
matrix. The transformation in Eq. (3.43) is called a similarity transformation. 


regarding eigenvalues of similar matrices. 


We now prove # 


sit 
e the 
enc ‘1, ist 


7 my a = z h 
Theorem 3.10 Similar matrices have the same characteristic equation (and nen 
eigenvalues). Further, if x is an eigenvector of A corresponding to the eigenvalue : : 2 
eigenvector of B corresponding to the eigenvalue A, where P is the similarity ma 


: i : : t is 
Proof Let A be an eigenvalue and x be the corresponding eigenvector of 4. Tha 
Ax = Ax. 
Pre-multiplying both sides by an invertible matrix P~', we obtain 


P 'Ax=AP 'x. 


Set x = Py. We get 


_—- 
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| Sia | 
PUAPy= AP 'Py, or (P''AP)y = Ay or By = Ay. 


-1 : : 
where B= pAP Theslore, 8 has the same eigenvalues as A, that is, the characterstic equation of 
is same as the characteristic equation of A. Now, A and B are similar matrices. Therefore, similar 


s have the same characteristic equation (and hence the same eigenvalues). Also, x = Py, that 


ice 
matric f A and B are related by x = Py or y = P™'>. 


eigenvectors 0 


pemark 22 


(a) Theorem 3.10 states that if two matrices are similar, then they have the same characterstic 
equation and hence the same eigenvalues. However, the converse of this theorem is not true. 
Two matrices which have the same characteristic equation need not always be similar. 


(b) If A is similar to B and B is similar to C, then A is similar to C. 
Let there be two invertible matrices P and Q such that 
A=P'BP and B=Q''CQ. 
Then A=P 'Q'CQP=R''CR, where R=QP. 


Example 3.37 Examine whether A is similar to B, where 
“pe 


yl tes 1 2] ay doe | 8) ort elt 2 
=—_ : an — . = = s 
Yl 9 "9 4 4 lg yl ™ 01 


Solution The given matrices are similar if there exists an invertible matrix P such that 


A=P 'BP or PA=BP. 


Let P = ° ‘| We shall determine a, b, c and d such that PA = BP and then check whether P is 
Cc 


non-singular. 


‘i a bl| § 5 1 2ila @ 5a-—2b Sa a+2c 6+2d 
| " : . | 
c dil-2 ol 1-3 alle al’ - |5e-2d Sc| |-3at+4ce -3b+4d 
Equating the corresponding elements, we obtain the system of equations 
Sa —- 2b=at+ 2c, or 4a-—2b-2c=0 
5a= bh + 2d, or Sa-b-—2d=0 
Sc — 2d = - 3a + 4c, or Ja+c-—2d=0 
5c or 36+ 5c —4d=0. 


A solution to this system of equations is a = 1, 6 = lle=l,d=2. 


(| 

| 
al 
> 
+ 
& 
a 


Therefore, we get P = ; i which is a non-singular matrix. Hence, the matrices A and B 
i 1 3 4 


are similar. 
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Equating the corresponding elements, we get 
Q@=a+c, b=b+d or c=d=0. 


Therefore, we get P = i | which is a singular matrix. 


Since an invertible matrix P does not exist, the matrices A and B are not similar 
It can be verified that the eigenvalues of A are 1, 1 whereas the eigenvalues of —_ 0 
4 2. 


In practice, it is usually difficult to obtain a non-singular matrix P which satisfies the equation 4 — ps 

for any two matrices A and B. however, it is possible to obtain the matrix P when A or B is oa : 

matnx. Thus, our interest is to find a similarity matrix P such that for a given matrix 4 We - - 
; ve 


D=P!AP or PDP'=A 


Where D is a diagonal matrix. If such a matrix exists, then we say that the matrix A js 
diagonalizable. 


Diagonalizable matrices 


A matrix A is diagonalizable, if it is similar to a diagonal matrix, that is there exists an invertibk 
matrix P such that P“' AP = D, where D is a diagonal matrix. Since, similar matrices have the same 
eigenvalues, /the diagonal elements of D are the eigenvalues of A: A necessary and sufficient conditea 


for the existence of P is given in the following theorem. — 


Theorem 3.11 a square matrix A of order n is diagonalizable if and only if it has linearly indepen®™ 
eigenvectors. 

Proof We shall prove only the if part, that is the case that if A has n linearly independent ee 
then A is diagonalizable. Let x,, x2, ..., x, be m linearly independent eigenvectors seat : 
the eigenvalues A,, A, ..., 4, (not necessarily distinct) of the matrix A in the same order, 
eigenvector x; corresponds to the eigenvalues A, j = 1, 2, ..., nm. let 


at 15 


i ; 3 ae fs \ vo - - 4 
of< / P= [x,, gg cacy x,,] | and( D = diag (A,, Ax» re An) : odo 
—h ae ee a jy ' ae att —_— d the 
be the diagonal matrix with eigenvalues of A as its diagonal elements. The matrix P is calle 
matrix of A and D is called the spectral matrix of A. We have 
AP =A [X,, X>, anny x,,] = (Ax, AXx,, sen Ax,,) a 


= (A,X), Ao&, ‘tek Agh,) @ Gigs Ras ging x,) D = PD. ag P 
fore the mat 


5] 
(a4 


__— 
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Since the columns of P are linearly independent, the rank of P in n and there 
invertible. Pre-multiplying both sides in Eq. (3.44) by P~', we obtain 
P-'AP = P-'Pp =D 


f ff .t Ff € FF GE E£ 





Matrices ‘and Eigenvalue Problems 3.67 


mplies that A is similar to D. Therefore, the matrix of eigenvectors P reduces a matrix A to 
ich 1 


h 
diagonal form. ; — , . 
its -qultiplying both sides in Eq. (3.44) by P ’, we obtain 
post- A= PDP". (3.46) 
k 23 


' 
at A square matrix A of order n has always n linearly independent eigenvectors when its 
9 .senvalues are distinct. The matrix may also have n linearly independent eigenvectors even 
. yn some eigenvalues are repeated (see Example 3.36 (i11)). Therefore, there is no 
restriction imposed on the eigenvalues of the matrix A in Theorem 3.11. 


(b) From Eq. (3.46), we obtain 
A? = AA = (PDP™') (PDP ') = PD’P ’. 
Repeating the pre-multiplication (post-multiplication) m times, we get 
A" = PD”P |! for any positive integer m. 
Therefore, if A is diagonalizable, so is A”. 
(c) If Disa diagonal matrix of order n, and 
TA, 0 a” 


Dp = Ar ;. _ then D” = 


A 0 qn 


= es 
TRAE 4 yp 


——e 
= 


at a 


for any positive integer mm. If O(D) is a polynomial in D, then we get 


—— 


O(A,) 0 


O(A2) | i 
Q(D) = iy 


0 OA) 
Now, let a matrix A be diagonalizable. Then, we have 
m p-! 

A =PDP-! and A”=PD'P 

for any positive integer Mm. Hence, we obtain 
-1 
Q(A) = PO(D)P 

for any matrix polynomial O(A). 


Example 3.38 Show that the matrix 


3 1 =! 
A=|-2 1 2 
O1 2 





i 
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i . that P'AP 15 2 diagonal matrix. Then, obtain the Matriy yer 
\ is diagonalizable. Hence, find P such 31 | 
: : ale B= A? ‘ 5A + . 
| ‘< given DY 
| Solution The characteristic equation of. AES 
geht Sl , 
Lui 9 — 23 6A-+ 1IA-6=0, Or Az] = 
anaul=]2 14S 23 ga 
‘ccdise cil three linearly independent eigen, | 
Since the matrix A has three distinct eigenvalues, it has SENVECtors and 
hence it is diagonalizable. ) 
The eigenvector corresponding to the eigenvalue A= 1 isthe solution of the system 1é 
~ | dia 
2 1 -l/|% 0 I js dE 
(A-I)x=|-2 0 2] {x | =] 0}. The solution is x; = )-1], soluti¢ 
| The eigenvector corresponding to the eigenvalue A = 2 is the solution of the system 
(A -—21)x=|-2 -1 2]|x,|=]0/)]. The solution is x, =]0|. 
0 1 Of} x, 0 i 
The eigenvector corresponding to the eigenvalue A = 3 is the solution of the system 
| 9 Fly 0 0 
(A-3I)x=|-2 -2 2 x2 |= |0]. The solution is x, =| 1}. 
0 1 -I{lx,{ |0 I 
Hence, the modal matrix iS given by 
Xt, Xp, x3] = | =] 0 Il] and P!'=/]2 1 -l 
| 1 | = 0 | 
| Pee beverified that FAP x uss (1, 2. 9, ci 
| We have D = dj | oe if 
ay 98 (1, 2, 3), D?= diag (1, 4, 9) 
o “Therefore, A? = 
a + 5A + 31 = pip? + 
5D + 31)p-!, 
10 0 
N 2 
Ow, D'+SD+31=10 4 gl, : 0) 3 0 0 9 0 0 
00 9 oo tle 3 Of=/0 17 9 
5} [0 0 3] Jo o 27, 
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| ence, we obtain 
, 1 1 o1/9 oO olf-1 -1 i] f 25 8 3 
A-+5A+3I=/-1 0 1//0 17. O}] 2. 1 -1/=/-18 9 18]. 
1 1 is0 o 27/|-1 0 1 2 8 19 


example 3.39 Examine whether the matrix A, where A is given by 


A 122 — 2 «3 
(JA=] 0 2 1, (ii) A=] 2 1 -6], 


-1 2 2 -1 -2 0 
is diagonalizable. If so, obtain the matrix P such that P-'AP is a diagonal matrix. 
Solution 
(i) The characteristic equation of the matrix A is given by 
1-A 2 2 
|A-AI| = 0 2-A l 
—] 2 2-A. 
=(1-A) a — =a) = 2-2-2 -H1-G-Be@- P-AW*. 


or A = 1, 2, 2. We first find the eigenvectors corresponding to the repeated eigenvalue 


A = 2. We have the system 


(A —21)x=| 0 0 1]} x, |=|9} 


linearly independent eigenvector. We 


onding to the eigenvalue A = 1. Since 
the matrix 1s not 


Since the rank of the coefficient matrix is 2, it has one 
obtain another linearly independent eigenvector correspLnt™ 
the matrix A has only two linearly independedent eigenvectors, 
diagonalizable. 
(ii) The characteristic equation of the matrix A is given by 
—2-A 2 =3 
|A-Al| = 2 1-A -6 =QorA+A 
‘ 


| —2J =—A 


_ 214-45 =0, or A=5, —3, -3. 


Eigenvector corresponding to the eigenvalue 4 = 5 is the solution of the system 


Sa? | 2 —3 Xx 


0 
(A — 51)x = 2 —4 -6 x, |=] 0}. 
_1 =2 ~SilaJ [¢ 
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T 
A solution of this system is [1. 2,1] 
solutions of the system 


Eigenvectors corresponding to 4A = -3 are the 
] 2 —3 x 0 
(A + 3] )x = 2 4 —6 X3 =|0| or Xx 2 2X _ 3x3 = 0. 
—| —2 3 xy 0 
|. Therefore, the system has two linearly jn de 


eigenvectors. We use the equation x, + 2X7 ~ 3x3 = 0 to find two linearly INdepen 
eigenvectors. Taking x; = 0, %2 ~ |. we obtain the eigenvector [~2, 1, O}” and takin 


r : 
x, = 1, we obtain the eigenvector (3, 0, 1]. The given 3 xX 3 matrix has thre 


independent eigenvectors. Therefore, 


The rank of the coefficient matrix is 


B 4,54 


“es : @ line 
the matrix A is diagonalizable. The modal matri, .” 
h 


given by 
29. 3 12 -3 
pPp=|2 10 and Pol = =|-2 4 6}. 
8 
={ Q@ 1 12 § 


It can be verified that P"'AP = diag (5, — 3, — 3). 
Example 3.40 The eigenvectors of a3 x 3 matrix A corresponding to the eigenvalues |, 1, 3a 
[1, 0, -1]”, [0, 1, -1]’ and [1, 1, 0)’ respectively. Find the matrix A. 


Solution We have 


| 1 01 1 0 0 
modal matrix P =| 0 1 1] and the spectral matrix D=|0 1 O|. 
7 »s bef — 6 00.3 
I -1 -] 
We find that p'= ri ft : 
1 1 1 
7 1 oui o of I -! -| 
Therefore, A=P DP" = o 1 ilo 1 off-1 1 7! 
-1 -1 olfo o 3}/ 1 ! 
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53 special Matrices © 
.< section, We define some special matrices and study the properties of the eigenvalues and 
‘ | 1 : = . * lal = i 
¥* tors of these matrices. These matrices have applications in many areas. We first give some 
genvector: , 
eigen 
»fpnitions. | | | 
- (X), Xa. 28s “y and y = (Vj, V2. «++, y,)" be two vectors of dimension 7 in IR” or C’. Then 
et 1 = IV |" “74 
. define the following: 
aed 


product (dot product) of vectors Let x and y be two vectors in IR”. Then 
jnner 
xiy= x'y => x,y; (3.47) 
i=| 
ner product of the vectors x and y and is a scalar. The inner ? 
y=y-x. Note thatx+x 20 and x - x = 0 if and only if x = 9. 


= ¥ product is also denoted 
is called the inner 

-> [In this case X * 
by < %5 ¥~: 


is defined as 
ifx and y are in C”. then the inner product of these vectors Is d 


n 5 n - 
=y’ Y= dx, and ysx=yx™ Dix 
=I 
————— i=] i 
¥ — 


x and y are complex conjugate vectors of x and y respectively. Note that x» y = y° *- 


x * ¥ 


—— 


where 
it can be easily verified that 


(ax + By): z= a(x+ 2) + BY +2 


for any vectors x, y, z and scalars a, B. 


Length (norm of a vector) Let x be a vector in IR” or C". Then 


? 2 
Ix] = yxex =yap $39 Fe tn 


is called the /ength or the norm of the vector X. 


= ) tor x/||x|| is always 
ait vector The vector x is called a unit vector if ||x|| = 1. If x 4 0, then vec |x || 
a unit vector. | 
( ich x» y = 0 are said to be orthogonal vectors. 


Orthogonal vectors The vectors x and y for wh 


Orthonormal vectors The vectors x and y for which 


x*y=0 and ||x/ = L; tel = 7 
= ‘s are 
ae called orthonormal vectors. If Xs y are any veclors and 7 6% 3 = Q, then x/||x|| y ly 


*rthonormal. For example, the set of vectors 


1} (0) (0 eal 
i) }O},) 1), | 0] form an orthonormal set in IR’. 
0) (0) \l 


ll Js li hlly, MmmgyyyLS-- 


Se 
é Ff 


| eh T et sky 


a 
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37/5) (-—4i/5 " 
P . . 3 4i/5 . 3i/5 5 
3) (-47) ( 0 sn orthogonal set in C3 and | 47 eH 
Gi) |4ih | i} Q | form 0 (+i 5 
Oo} \ oO} (ltl 
set in C. 


| 1a] 
form an orthonorma x, be n vectors in IR” The 
a | N 


Let XY. X>; eer 
ectors, if 


» this 


m of vectors 


d unitary syste 
Orthonormal an | system of v 


set of vectors forms an O7 thonuorma 


, 0, i#/J 
Ee yr ery Vy, fay. 


x. ben vectors in C”. Then, this set of vectors forms an wrtitary system of Vectors 
MY 0 


0, i#/J | 
Tie eee Was ae | PR 


Diet ity Ray nen 


In section 3.2.2, we have defined symmetric, skew-symmetric, Hermitian and Skew-Hemmitigy 


matrices. We now define a few more special matrices. 


; | ceiged os a? 
Orthogonal matrices A real matrix A Is orthogonal if A '= A’. A simple example is 


cos@ -—sin@ 
A=! . 
sin@  cos@ 
A linear transformation in which the matrix of transformation is an orthogonal matrix is called a 
orthogonal transformation. 


Unitary matrices A complex matrix A is unitary os A! = (A)’, 
unitary matrix is same as orthogonal matrix. A iN aT 


or (A)! = A’. If A is real, then 


A linear transformation i in which the matrix of transformation is a unitary matrix is called a unilay 
tranformation. 


We note the following: 


1. If A and B are Hermitian 
a, B, since 


(@A+ BB)’ = (@A + BB)’ = aA’ + BB" =aA+BB 
2. Eigenvalues and elgenvecto | 


matrices, then @A + BB is also Hermitian for any real scalas 


rs : | ) 
of A, since of A are the conjugates of the eigenvalues and eigenvec'™ 
—P 
AR = Ax gives AX = 7x. 
3. The inverse of a unit 
a oO : | qr 
Let B= A-!. Then TY (orthogonal) matrix is unitary (orthogonal). We have ales 


Bo! 


=A = (A7)- 


“(AYP = (ast = BP 
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where 
follo¥ 
matri 
requil 
rows. 
n bet 
subse 
satisf 


Cons 


Let ¢ 
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piagonally dominant matrix A matrix A = (a,) is said to be diagonally dominant, if 


n 
la,;| 2 »? —|a,|, for all i. 
J=hery 


the system of equations Ax = b, is called a diagonally dominant system, if the above conditions are 
nd the strict inequality is satisfied for at least one i. If the strict inequality is satisfied for 


satisfied a ‘ ‘ 
all i, then it is called a strictly diagonally dominant system. 


rmutation matrix A matrix P is called a permutation matrix if it has exactly one | in each row 


Pe 
n and all other elements are 0. 


and colum 
Aofa matrix Let B be a sparse matrix. Then, the matrix B is said to satisfy the property 


property A of ® : 7 
4. if and only if there exists a permutation matrix P such that 
PBP’ = ins = 
Ay, Ar 


where A, and A. are diagonal matrices. The similarity transformation performs row interchanges 
followed by corresponding column interchanges in B such that A,, and A, become diagonal 
matrices. The following procedure is a simple way of testing whether B can be reduced to the 
required form. It finds the locations of the non-zero elements and tests whether the interchanges of 
rows and corresponding interchanges of columns are possible to bring B to the required form. Let 
n be the order of the matrix B and b,, # 0. Denote the set U = {1, 2, 3, ..., n}. Let there exist disjoint 
subsets U, and U, such that U = U, U U2, where the suffixes of the non-zero off diagonal elements 
b, 0, i#k, can be grouped as either (fe U;, ke U,) or (i € U;, k € U,). Then, the matrix B 
satisfies property A. 


—2 1 O 
Consider, for example the matrix B=; 1-2 I}. 
0 1 -2 


1 0 Olf-2 1. Of}f! O 0 
Then, PBP’=|0 0 I|| 1 -2 J{/0 0 | 
01 0]/ O 1 -2{,0 1 0 


So 

So 
| 

tJ 
S 


} —f 0 ff 
-/o o 1/| 1 1 -2J/=] 0 -2 


[te 4) 
t 1] (-2) A>, Ar? | 


— 
S 
So 

\ 
th 
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Fe = 


Oe ee ee 


Stee 2 ees = 


a 
- . a + 
i o 


—— be So ce TS te 
Se a hk 


a 





= © — ; 





E . } atics + | 


| im 

c. | 

aa 3 followed by an interchange of 

yg rows 2 and 3, il 
Ine : 


at, 
Ny) 


* ' 
- onal ‘matric 
where A,, and Az are diagonal -m . 


interchang 
transformation is equivalent to int 


— | 
and ce | L/ 2 E U3: a31 ey | : 

i E i = ‘ x : 2! CX Tr 4 
(,, 2, 3 @* ‘ os U,. Subsets U, = tl. 35. U2 = 12h exist Such 


ii. 2 wer 
UW U3. Hence, 


i) 


Now, a, # 9. 1 = 
ae 1403 € Gs 
U = i, 2, 3} = U; 


ant results. 


. ‘ > import a aT 
We now establish some '™P rly independent. 


sf O 
3.12 An orthogonal set ¢ 
x,,, be an orthogonal set © 


r vectors 1S jinea - 
that is x; + Xj = 9, ##J- Consider the Vey 


Therorem aa 


Proof Let X). *2 - 


= ( , 
— x = OX + O4X_ To + OinXm (3.44 
, — a _ -_ . | F E . | ; 
Taking the inner product of the vector x tn Eq. (7.48) withy, 
, ‘a 
M,, are scalars. 


where ean Oh. so 85 


ve gel : 
_ xox) = (4X1 + 2 


|. = » 3 = 0 
aa On Xm) xy 0 xy 


* 
-_— — O 
X1/ : 
-x,)=0 or & xii | 
aking the in 
= 0, Therefor 


6 (X| ner products of x with Xz, X3...01, 


or 
e, the set of orthogonal vectors x,, 1, 


= 0. Similarly, t 


' te [2 > get @ 
Since Ix ill FY, WE E : Hy ~ + = Ay 


successively, WE find that Q = 
X,, 15 linearly independent. 


Theorem 3.13 The eigenvalues of 


(i) an Hermitian matrix are real. 

an matrix are zero OF 
x are of magnitude I. 

e corresponding eigenvector 0 


iti ure imaginary. 
(ii) a skew-Henmitl Pp 


(iii) an unitary matt 


1 be an eigenvalue and x be th 
by x’, we get 


f the matrix A. We have 


Proof Let : 
Ax = Ax. Pre-multiplying both sides 


(3.43) 


— Sr i pas! pied 
x’ Ax=Ax x OF ia 
Ss i way 
r Also. the denominator x X I 
x7 d x’ x are scalars. i 
Note that xX AX an 


= i 
Therefore, the behavior of A is governed by the scalar x AX. 


Pt 7 ‘ . _ Tr 
(i) Let A be an Hermitian matrix, that is A =A’. Now, 
(x’Ax) = x’ Ax=x"AT¥=(x'A rx)? =x" Ax 
since x’ A’ Xx is a scalar. Therefore, x’ Ax is real. From Eq. (3-49) 


real. 


(ii) Let A bea skew-Hermitian matrix, that is A? = —A. Now, 


(x’Ax) = x? AX =—xA'X = -(x7A'X) = —X'AX 
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| Thl= ics | =T a. : 
since X A X 18 a scalar, Therefore, x’ Ax is zero or pure imaginary. From Eq, (3.49), we 


conclude that A is zero or pure imaginary. 


(ii) Let A be an unitary matrix, that is A! = (A)’. Now, from 
Ax =Ax or Ax =AX (3.50) 
seen = T sats = 
— (Ax)? =(4x7) or X7 AT = AX. 
a x7A| = Ax’. (3.51) 


Using Eqs. (3.50) and (3.51), we can write 


(x7 AT) (Ax) = (AX7)(Ax) = [AP ex 
or xox = Al)? x’x. 
Since x # 0, we have x’ x + 0. Therefore, |A|’ = |, or |A| = 1. Hence, the result. 
Remark 24 
From Theore 


2L(i) a symmetric matrix are real. 
Adil) a skew-symmetric matrix are 
4 (iii) an orthogonal matrix are of magnitu 


m 3.13, we conclude that the eigenvalues of 


zero or pure imaginary. 
de 1 and are real or complex conjugate pairs. iS 


Theorem 3.14 The column vectors (and also row vectors) of an unitary matrix form an unitary 


system of vectors. 
“ . “ | - 
Proof Let A be an unitary matrix of order n, with column vectors X), Ks,,.0c09 Kye Phen \y 
\ 
= - =v. —T \ 
“i KX, XX X) Xn a 
rey —T —. =k 
: —T X - X5X, X5X>5 are X,X,, 7 
A'A= A'A= - [X), Xoo oes £,| = a 
: af. oF <T 
a x, X| X,X%2 ++ X, Xn 
. 0, 1#J 
Therefore, x) x,= } ! 
iT lh, b=J. 


unitary matrix is also 


em. Since the inverse of an 
we conclude that the 


Hence, the column vectors of A form an unitary syst 
the rows of A, 


an unitary matrix and the columns of A-! are the conjugate of 
r ; 
OW vectors of A also form an unitary system 


Rema 
rk 25 
that the column vectors (and also the row vectors) of an 


(a) From Theorem 3.14. we conclude 
al system of vectors. 


orthogonal matrix form an orthonorm 





y 
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(b) A symmetric matrix of order 1 ha 


> diagonlizable. Me 
r ame elon 
* Example 3.41 Show that the matrices A and A ae the sc “isenvalues and fa, d 
eigenvalues the eigenvectors corresponding to A and A" are:mutuslly orthogonal, th 


Solution We have 

1A — AL = |(A2)? - AIT = |[AT — AN] = |AT- a0, 
Since A and A’ have the same characteristic equation, they have the same eigenvalues 
Let A and pu be two distinct eigenvalues of A. Let x be the eigenvector Corresponding b 
eigenvalue A for A and y be the eigenvector corresponding to the eigenvalue y for 47 We - 
Ax = Ax. Pre-multiplying by y’, we get * 


y' Ax= Ay'x. 85) 
\T Te wget 
We also have A’y = py, or (A’y)’ = (uy)’ or yA =HYy. 


Post-multiplying by x, we get 


y’Ax = uy'x (3.53) 
Subtracting Eqs. (3.52) and (3.53), we obtain 
q (A - p)y’x=0. 


yo. 
¥, a 
~ Since A # HM, we obtain y’x =). Therefore, the vectors x and y are mutually orthogonal. 


3.6 Quadratic Forms 


Let x = (X), X2) «++ x,)’ be an arbitrary vector in IR". A real quadratic form is an homogeneous 


expression of the form 
n nt =) 
(3.54) 
O=> 2 aj; X; xX; 
i=| j=l 
in which the total power in each term is 2, Expanding, we can write 
y= ay\x° + (Ajo + @o3) Xy Xp +... + (Ayq + Bn) FU% 


> x 
+ 459 x5 7 (a>, + a>) X54 Xy T sca SF (43, + a,2) X34n 


“ 
P 


T wee Anny Xp asi 


= x’Ax 
x B= (b,) 


using the definition of matrix multiplication. Now, set by = (a4, + a,/2. The matri a 


symmetric since 5, = b,. Further, b, + 6, = a; + a), Hence, Eq. (3.55) can be wtitte 
O= x'Bx 


where B is a symmetric matrix and 5; = (a, + a,,)/2. 


A 
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31 Introduction 


in modern mathematics, matnix theory occupies an important place and has applications in almost all 
branches of engineering and physicai sciences. Matrices of order m x n form a vector space and they 
define linear transformations which map vector spaces consisting of vectors in IR" or C" into another 
vector space consisting of vectors in IR” or C” under a given set of rules of rules of vector addition and 
scalar multiplication. A matrix does not denote a number and no value can be assigned to it. The usual 
rules of arithmetic operations do not hold for matrices. The rules defining the operations on matrices 
are usually called its algebra. In this chapter we shall discuss the matrix algebra and its use in solving 
linear system of algebraic equation Ax = b and solving the eigenvalue problem Ax = Ax. 


3.2 Matrices 


Anim X n matrix is an arrangement of mn objects (not necessarily distinct) in m rows and n columns 
in the form 


4 


he. Se 
an, 4 On 

ae (3.1) 
Qn, Gn2 “" Qinn 


We say that the matrix is of order m x n (m by n). The objects Qj), @y, «++» Amn Ate called the elements 
‘the matrix. Each element of the matrix can.be a real or complex number or a function of one or more 
“atables or any other object. The element a, which is common to the ith row and the jth column is 

ed its general element. The matrices are usually denoted by boldface uppercase letters A, B, C, ... 

When the order of the matrix is understood, we can simply write A = (aj). If all the element of a 
Matrix are real, it is called a real matrix, whereas if one or more elements of a matrix are complex it 
S called a complex matrix. We define the following type of matrices. 











cilbatiins i itt | 


/ A eae Vhirtlncnetge 5 
una fia 
ie 


it dices crrer Tae 


Raw Vector A cnnates otiorder |} <a, that ps: 
ora res matrex of order a aids written iis 
lary, if ify i 4] Jas i if | 
mowhirch ct) fora pas the yth clement 
Colunin vector A mates ot order ma: » |, that as, 1 Das ver rans and one Columbus... CO 
Warp py 
vector or a cofmmn mati of order ar and is written ats 
Ay | fh 
fy fo, 
i ey 
fr fr 


 cobors are ustially denoted 
u 


in which b (or h) is the sth element. 


The number of elements i a row column vector is called is onder The 
ete. [fa veetor has -: elements and all its elements ar | 
: tC Tes 


lements are complex 


by boldface lower case letters a, b, ¢, 
nuntbers, then its called an endercd n-fagpfe in IR’, whereas i one or more ¢ 


ru 


numbers, then it is called an ordered a-aiple in © 
Rectangular matrix A matrix A of order at = n,m # nis called a rectanetlir mates 
Square matrices A matrix A of order a x nin which m = 7, that is number of pows js equal to 


the number of columns is called a square matrix of order n. The elements a,,. that 1s the elements 
. 4,, are called the diagonal elements and the line on which these elements lie 1s called 


iy. ilar, ne 
the principal diagonal or the main diagonal of the matrix. The elements ihe, Clon: teh mare itin 
the off-diagonal elements, The sum of the diagonal elements of a square matrix 1s called the race 


of the matrix. 
Nul j a ; fi in . 
I matrix A matrix A of order m x n in which all the elements are zero ts called a aud! marrix 


or a Zero matrix and ts denoted by 0. 
i #/ are zero is 


Di ji : 
agonal matrix A square matnix A in which all the off-diagonal elements a,, 
called a diagonal matrix. For example ; 
lay, 
5 : 
Is a diagonal matrix of order Hn. 


A dia er 
we re aa ‘ denoted by D. It is also written as diag [a,, a5) ... a,,]. 
nts of a diagonal matrix of order n are equal, that is a, =a for all 7, then the matrix 


i called a scalar matrix of order n 
all the eleme a di 4 
a ace of a diagonal matrix of order n are I, then the matrix 


(ii) their 


a 
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/ 0 
; | 3 | 
A= is called an unit matrix or an identity matrix of order n. 
t} | 
an identity matrix 15 denoted by I. : 
j matrices Two matrices A = (4jj)mxn and B = (by),,4 are said to be equal, when 
- | i 4 é, 
Eq" i) they are of the same order, thal is m= p,n=q and 
' | ~ = rt 
corresponding elements are equal, that is a, = by for all i, j. 
atrix obtained by omitting some rows and or columns from a given matrix A is 


A. As a convention, the given matrix A is also taken as the submatrix of A. 


submatrix A se 
d a submartix of 


calle 
3.2.1 Matrix Algebra 
The basic operations allowed on matrices are 


(i) multiplication of a matrix by a scalar, 
(ii) addition/subtraction of two matrices, 

(iii) multiplication of two matrices. 
Note that there is no concept of dividing a matrix by a matrix. Therefore, the operation A/B where 
A and B are matrices is not defined. 


Multiplication of a matrix by a scalar 
(a;,) be a given matrix of order m X Nn. Then 
(3.2) 


Let a be a scalar (real or complex) and A = 
B= aA = Q@(a;) = (a@a;) for all i and /. 
The order of the new matrix B is same as that of the matrix A. | ‘ 
Addition/subtraction of two matrices 
Let A = (a,,) and B = (b,) be two matrices of the same order. Then oa 
| C = (cj) = At B = (a,) + (54) = (a,;, + 5,), for alli ili (3.3a) 
for all i and /. (3.3b) 


A — B= (a,) - (54) = (a, — 5;,), 
e matrices A and B. Matrices of the same 


D= (di;) %y 
he same as that of th 


and 
The order of the new matrix C or D is the same * 
order are said to be conformable aaa se: d a@,, are any scalars 
trices which are conformable for addition and @, 2. ---» Op 
If A), A, aE | A, are p ma 
then | (3.4) 
C= aA, + OA, to 7 AyAn j 
| . 4. The order of the matrix C is same as 
i 


oso? 7 


i 1 ices A), A>. 
is called a linear combination of the matrices 4, 


that of A. i = by 2s are p. 





Prihg 
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? IFtin i iti 
Properties of the matrix addition and scalar multiplication 
Le hithe phabtiaoe ‘ ; 
LA, B, C be the matrices which are conformable for addition and oo ff he 
Sh at § Then 


I. A+B=B+A. (commutative law) 
2.(A+B)+C=-A+(B4 €) (associative Jaw) 

3. A+O=A (0 is the null matrix of the same cries , 
4, A+(-A)=0. 2. CHA +B) Ga op 
6. (@+ BDA = oA 4 BA 7. @ i BA) — pn 

8 1x A=A_ and Ox A= 0. 


Multiplication of two Matrices 


The prod | ee = - 
product AB of two matrices A and B is defined only when the number. 


to the nv vem FE : Colutams in 
«¢ NuUMber of rows in B. Such matnces are said to be confarnygile tor rai tt 








MOT MMII PT hocatpey : 
be an m < nm matrix and B = (4;) be an a x p matrix. Then the product mats sie 
Bis, 2: 8 b. | 
5,2 6, | bap | 
=: my =< 7 yx 
1s ; - iJ 1 
pa a matrix of order mx p. The gencral element of the product matrix C is given by 
Cc. = 4h = 
y ay lj + aj2by, T «a * inn, = = a;, Dy. (3.5) 
= k=! : 
In the product AB, B is said t ltipli 
a le Arca be pre-muluplied by A or A is said to be post-multiplied by B. 
of order | x 1, that is a <j l * 7 and B is a column matrix of order n x 1, then AB is a matrix 
Ci ’ Single element, and BA is a matnx of order n x n 
Remark | 
(a) It is possi : : 
ss product matrix BA 02 ah A and B, the product matrix AB is defined but the 
3 x4 ) _" - fines ae fae fined. For example, if A 1s a 2 x 3 matrix and B 5 a 


AB is defined and js a matnix of order 2 x 4, whereas 


aes Pa ae 


id BA are defined, then both the matrices AB and BA are 


1 tera -/ an 
a ts 2. i _ . 
mata 7a oes the matrix product is not commutative. 
are Sald to commute with each other. 


then 





AB = 


0 
0 


0 
0 


and B= 


and BA 


Matrices and Eigenvalue Problems 3.5 


0 O 
ab 


0 


ax + by 


= 


0 
0) 


7 


+ AB. 


Properties 0 
r 


it does not always imply that B=C. 
AxA... * A (k times). Then, a matrix A such that A‘ = 0 for some positive 
e smallest value of k for which A* = 0 is called the index 


(d) If AB = AC, 


x 
Define A = 
© integer & 1s said to be nilpotent. Th 


of nilpotency of the matrix A. | 
(f) If A? = A, then A Is called an idempotent matrix, 


f matrix multiplication 


1. If A, B, C are matrices of order m xn, n x p and p x gq respectively, then 
* . 


(AB)C = A(BC) (associative law) 


is a matrix of order m x q. 
2. If A is a matrix of order m x n and B, C are matrices of order n x p, then 


A (B + C)=AB+ AC (left distributive law). 


3. If A, B are matrices of order m x n and C is a matrix of order n x p, then 

(A + B)C = AC + BC (right distributive law). 
4. If A is a matrix of order m x n and B is a matrix of order n x p, then 
a(AB) = A(a@B) = (a A)B 


for any scalar a 


3.2.2 Some Special Matrices 


We now define some special matrices. 
e matrix obtained by interchanging the corresponding rows and columns 


T | Th ws and col 
sts ‘me ee called the transpose matrix of A and is denoted by A’ or A’, that is, if 


a a ay om Ty 
dj) ay? “ae bw 1 i 
-- Os T 2 8x gs 
A a, Ox ‘ then A = : = : b 
= = = 


Ge ae em Qj, Fs Sum 
m matrix. Also, both the product matrices A’A and AA” 


; T; x 
If A is an m xn matrix, then A is ana 


{ are defined, and is ann X nm square matrix 


ATA = (n x my X ”) 


—_ Sa so 





‘n ——= 
ee 


3.6 Eneineerine Mathenatres 


and AA = (m x a)(n *% nr) is ane & Ar square Mathys 


r 
A column vector b can also be written as [A, Ayo. h, | 


The following results can be easily verified 


I. The transpose of a row matrix is a column matrix and the transpose Of a column matnyy 1s 
a row malnx. 
2. (A’y" = A. . 
3. (A + By’ = Al + B’, when the matrices A and B are conformable tor addition 
4. (AB) = B’A’, when the matrices A and B are contormable for mulipheation 
If the product A, A, ... A, 1s defined, then 
: r 
[Ay Age Ag]? = AG AG poe Ad 
Remark 2 


The product of a row vector a, = (a2,, a _a,,) of order | x 2 and a column vector 
b, = (5), 6, ... 6 


a, and b,, that 15 


i a2. 


\" of order x x | is called the dot product or the inner prod 


Poul they Vectors 


a 


c,=a b= } ayly, 


which is a scalar. In terms of the inner products, the product matrix C in bq. (3 45) can be written as 


ae a,b, a,b, as a,b, 
a,"b, a,b, reales a,b, 

aa il | aaa (3.6) 
. a, 7d, a,,"b, aa a, ‘b,, 





Symmetric and skew-symmetric matrices A real Square matrix A = (a,,) 1s said to be 
symmetric, if ay= a, for all ¢ and j, that is A = A? 
skew-symmeiric, if ay, = 


Remark 3 


~ 4, for all i and /, that is A = — A” 


a L 5 = 1 1 a a J 

| a ‘ a synmneinc matrix A = (a;), all its diagonal elements are zero. 
a (c) For = ene 2 ois synumetric’and skew-symmetric must be a null matrix. 

| ee wal square matrix A, the matrix A + A’ is z ' : i 
1s always skew-symmetric, Therefore, a real 98 Is always symmetric and the matrix A- A 


symmetric matrix and a skew-symmetric matrix. That is 





I 
= ee 
A 5 A A(R A3). 


a 
‘ ‘eral? a 


atrices A square matrix A = 


<j, that is all elements abov 
= 0, whenever j > e the 


(ay) is called a fower triangular matrix if aj; = 0, 
Principal diagonal are zero and an upper triangular 


J, that ts all the elements below the principal diagonal are zero. 


a 


te 3 = ier 





‘| ae oo 
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Conjugate matrix Let A = (a,,) be a complex matrix. Let a, denote the complex conjugate of a,. 


Then, the matrix A = (a,) is called the conjugate matrix of A. 


Hermitian and skew-Hermitian matrices A complex matrix A is called an Hermitian matrix if 
)’. Sometimes, a 


Hermitian matrix is denoted by A” or A*. 


Remark 4 P 


(a) If A is a real matrix, then an Hermitian matrix is same as a symmetric matrix and a 
skew-Hermitian matrix is same as a skew-symmetric matrix. 


(b) In an Hermitian matrix, all the diagonal elements are real (let a, = x, + iy, then a, = @ , gives 
x, + iy; = xX; — iy, OF yy, = 0 for all j). . 

(c) In a skew-Hermitian matrix, all the diagonal elements are either 0 or pure imaginary 
(let ay = x, + iy; then ay = — @y gives x, + iy, = — (x, — ty) or x; = 0 for all /). 

(a) For any complex square matrix A, the matrix A + A’ is always an Hermitian matrix and the 


matrix A — A’ is always a skew-Hermitian matrix. Therefore, a complex square matnix A can 
be written as the sum of an Hermitian matrix and a skew-Hermitian matrix, that ts 


5 i eee ) 


Example 3.1 Let A and B be two symmetric matrices of the same order. Show that the matrix AB 
is symmetric if and only if AB = BA, that is the matrices A and B commute. 


Solution Since the matrices A and B are symmetric, we have 
A’=A and B’=B. 
Let AB be symmetric. Then 
3 (AB)'=AB, or B’A’=AB, or BA = AB. 
Now, let AB = BA. Taking transpose on both sides, we get 
(AB)’ = (BA)’ = A’B’ = AB. 


Hence, the result. 


3.2.3 Determinants 


With every square matrix A of order n, we associate a determinant of order n which is denoted by 
det (A) or |A|. The determinant has a value and this value is real if the matrix A is real and may be 
real or complex, if the matrix is complex. A determinant of order 7m is defined as 


ay, 12 "" Gin 


a3, 4 °" 225 
det(A)=|A|=| - 


1 
a: — 


Gy, Gn2 ~" Ann 
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af ud 


= 2 (1a, M4, = 3 cagA, 


j=l pel 


e ir re ; rr 
= 2 (-1)"% a, M,; = X ay A,, 
a red | (4.7) 
where Af, and 4, are the arinors and cofactars of a,, respectively. 


We give now some important properties of determinants. 


I. If all the elements of a row (or column) are zero then the value of 


the deter; ‘ 
2. JAl = JA), TOINAN is zen 


multiplied by (—1). OF the determinan, 


4. If the corresponding elements of two rows (or | 
1 columns) are Proportional 
then the value of the determinant is zero. > each Other, 


5. If each clement of a row (or column) is multiplied by a scalar @ then 
determinant is multiplied by the scalar Therefore, if fis a factor of ¢ 
(or column), then this factor # can be taken out of the determinant. 


Note that when we multiply a matrix vy a scalar @, then every element 
multiplied by @. Therefore, |@A| = a@"|A| where A is a matrix of order n 


6. If a non-zero constant multiple of the elements of some row (or column) is added 
| 0 the 


Corresponding elements of some other row (or column). | | 
remains unchanged. ok seein 


7. |A+ Bl = JA] + Bl, in general. 
Remark 4 
When the elements of the 


1S 


the 
ach clement of a 


row 





of the Matrix, is 


es : j/th row are multiplied by a non-zero constant & and ; 
ener aap of the sth row, Wwe denote this operation as 2, — Ri + kR,, ona rs 
St chenydead a ements of the-/th row remain unchanged whereas the elements of the ith row 
" Cases ie ae Is called an elementary row operation. Similarly, the operation 
Thoretecs. maa : ere C, is the ‘th column of [A], ts called the elementary column operation 
erementary row (or column) operations, the value of a determinant is unchanged. 


P 
roduct of two determinants 


If A 
and B are two Square matrices of the same order, then 
[AB] =|A] |B]. 


: we can multiply two dete 
(1) row by row, 
(iti) row by column, 


Since |A] = [A7} 4 2 
fminants m any one of the following ways 


(i) column by column, 
(iv) column by row, 


-_ 


T; a 
he value of the determinant is Same in each case 


q aank . -. A. denoted by r or rA 
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) is the order of the largest non-zero minor of | Al. 
f a matrix is the largest value of r, for which there exists at least one r x r 
the rank OF : ot zero. Thus, for an m x n mainx rs min (m, n). For a square 


ames eterminant Is 0 . Fe 
The artix of A whose d A| + 0, otherwise r <n. The rank of a null matrix Is zero and 


the rank r= 7 if | 
« saa 7 I) matrix 
~AO - «<Q. then it must be a null matrix. 
matris of matrix Is ¥. 
‘eehe rank 


if the - Find.all values of p for which rank of the matrix 
example " jp = 0 O 
o pw —-! O 
a @ OF we St 
a oe oe ee 
; ‘ 3. 
is - to -_-@ the matrix A is of order 4, r(A) <4. Now, r(A) = 3, if [A] = 0 and there is 2t least 
le age order 3 whose determinant is not zero. Expanding the determinant through the 


one submatrix © 
elements of first row, we get 


p -l 0 | ire S| | 
11 -6 OW .|-6 -6 1 


= pp — 6p + ip — 6 = (we 1p — 2)(H — 3). 


Setting |A| = 0. we obtain pt = 1, 2, 3. For u = 1, 2, 3, the determinant of the leading third order 


submatrix 
ol 0 
IAJ=]0 wo -i)=e #0. 
0 O yp 


Hence, r(A) = 3, when p = | or 2 or 3. For other values of p, r(A) = 4. 


3.2.4 Inverse of a Square Matrix 


Let A= (a;,) be a square matrix of order n. Then, A ts called a 


(i) singular matrix if |A| = 9, 

(ii) non-singular matrix if |A| # 9- 
In other words, a square matrix of order n is singular if its rank r(A) <n and non-singular if its rank 
r(A) = n. A square non-singular matrix A of order n is said to be invertible, if there exists a 


non-singular square matrix B of order n such that 
AB = BA =I (3.8) 
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Mae ee NY main OE eles, The nate canes x © 0 zi) 
write B = 4 =B =n ; ov. “ Nverse oh | : 
Ao A= B". Hence, we say that A~ is the dries: Of the oe mares of 4 sai — w that the matrix A = |35 | 0) satisfies the matrix equation A’ — 6A- - 
ATA = AA” =x § Matrix A, if We | ae 32 Sho ‘es | 3 
The inverse, A“ of the matrix A is given by (3.9) - cn nere 1is an identity matrix of order 3. Hence, find the matrix (7) A’! and (it) AW 
: | ,=0w 
An ig, OHA) a We have 
si _ 2 @ =17% © <1] Ta ~j <6 
where adj(A) = adjoint matrix of A oo) gz= lS 2 OFS 1 Offs a 5), 
~ "anspose of the matrix of cofactors of A. ax ane t 3 5 4 «9 
Remark 6 és | 
(a) (ABy' = B7a-! a - 4 -1 -5|)2 0 ‘) 3 -6 -19 
“wy ae 3 «tA = -5||/5 1 O,=)35 —4 =I0t. 
We have - | ase | 
. “ . § 4 910 1 | 31S = 
(AB)(AB)' = I, E n 
ree a a % - . get 
Pre-multiplying both sides first by A~! and then by Ba! ice obtain Fe gating in B= A> — 6A* + LIA —I, we ge 
. B-'A~'(AB)(AB)! = B-'(A'A) B(AB)" = B-'4” o- (AB)! = B'4-! c. \ ae 3 -6 -19| |24 -6 —-30 22 0-11] [' oO © 
In general, we have (A, A)... A,)' = At! AD re ae we (35 =4 -30]/—|90 6 -30)+/55 Th O,-[0 1 0 
3 pels: a 0 1 
(b) If A and B are non-singular matrices, then AB is also a non-singular matrix es 30 #13 «22 30 240 4 OG Ul 33 0 
(c) If AB = 0 and A is a non-sin i 
singular matrix, then B Ix. si = 
pre-multiplied by A". If B is non-singular matrix, then . ane iil cs imap a2 2 
> post-multiplied by B~! » © 4a null matnix, since AB = 0 can =e © 610 
(0) IAB = AC and A is a non-singular matrix, then B = C (see Remark 1(d)). ) —_ 0 0 0 
(e) (A + BY 2A" + B ij, | Peay 2 
» In general, ' DN es a - 
: oe ee (aero ae IA -1=0DbDyA , we gel 
) ae ss ~ (i) Premultiplying AX — 6A° + | 
Propertics of inverse martices 4 ‘. acta? — GAA? + ATA — at =0 
I. If A“'exists. then it is uni | ee . : 
sts. ) que. ies §. AT! = A*_ 6A + 111 
2. (A's. . Poe A “AO — 
h-t rs ; . , = J i o oO 7; = 
$. (A (A). (From (AA!) = J? = I, we get (A™')"A7 = I. Hence, the result). es a +lo uo ol=|-!18 6 -5 
4 Ret D = diag (diy. dew «... dy), dy #0. Then, D“! = diag (Iid)), Ida, ... Wd). “6 Dea on g~i 2 
5. The inverse of a non-sin : 9 | 0 6 18 ¥ 9 
: ingular upper or lower triancul ix j ctive! ora 5 4 
lower triangular matrix. na RE AY reeled fot UP . 
6. The inverse of # non-singular symmetric matrix is a symmetric matrix 3 oe ty aL * 5 ae 
7. (A”')" = A™ for any positive integer 1. s(@pal-is 6 -5-15 6 -§|=|-160 61 —55}- 
© goon eusaeey 155 2 PY 
~— Weecan also write ae . 
i Sr 2p) (A") = A- 61+ IMA). 
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ayyxy + M\3X5 + 


oF aigX, = by 


G5) x, + Ua9X5 + 


ie 43,,X), = bs 
: : ‘ Q,4,) + O,9%5 F 22. + 2 .X_7 = Bs G " 
fn Matrix ss Jb 
orm. We can write the system of equations (3.11) as 
Ax=b 
(3.12) 
yy M2 + a), by, x, 
where Aa | Gh s+ ty “es b, eal? 
7 sie o * => P 
a.) a7 aes a. 5, x 


and A, b, x are respective ght hand side column vector and the 
solution vector. If b #0. t 


: }> 92, -.-. 6, iS not zero, then the System 
of equations is called non-homogeneous. If b = 0. t 


, then the system of equations iS valled 
homogeneous. The system of equations is called consistent if it has at least one solution and 
inconsistent if it has no solution. 


Non- 


ly called the coefficient matrix, the ri 
hat is, at least one of the elements 6 


homogeneous system of equations 
The non-homogeneous System of equations Ax = 


b can be solved by the following methods. 
Matrix method 


Let A be non-singular. Pre-multiplying Ax = b by A7', we obtain 


x=A'b. 


The system of equations is consistent and 
is the only solution. 


(3.13) 
has a unique solution. If b = 0, then x = 0 (trivial solution) 


Cramer's rule 


Let A be non-singular. The Cramer's rule for the solution of Ax = b is given by 
A. 

x;= Ad id aa _ (3.14) 
|A| 


where |A,| is the determinant of the matrix A, obtained by 
hand side column vector b. 


We discuss the following cases. 


replacing the ith column of A by the right 
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\A| # 9, the system of equations is consistent and the unique solution ts obtained by 
When 


cast I 3,14). 
ysin when JAI = 0 and one or more of |A), i=1,2 on. are not zero, then the system o 
case 2 nas 70 solution, that is the system is inconsistent. 

ns 


quan when |Al = 0 and all |A,| = 0,1 = 1, 2, ..., m, then the system of equations is consistent 


finite number one-parameter family of 
snd has 
- ns- 
soluti of equations 
neous system ¢ 
plomoee 


ider the homogeneous system of equations 
oF Ax = 0, (3.15) 
trivial solution x = 0 is always a solution of this system. 
- .¢ non-singular, then again x = A” 0 = 0 is the solution. | 
qherefore, a homogeneous system of equations is always consistent We con :lude that non-trivial 


‘ons for Ax = 0 exist if and only if A is singular. In this case. the homegencous system of 
enn has infinite number of solutions. 


Example 3.4 Show that the system of equations 


has a unique solution. Solve this system using (i) matrix method, (ii) Cramer's rule. 
Solution We find that 


1 -l i 
|A}=|2 1 -3]=101+3)-26-1-1N+1G-1=10 £0. 
_ ' 


Therefore, the coefficient matrix A is non-singular and the given system of equations has a unique 
‘Solution. Let x = ix, y, zy". 


(i) We obtain 


de 
Pal 
bea 


Therefore, 


u 
* 
or 
" 
| 
aA 
= 
in = 


bd 


Hence, r= 2, y= —| and i ™ l. 
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, 4 -!} 1 
(ii) We hav 
c [A|=|9 1 -3}=4(1 + 3)-0+ 23-1) = 20. 
ee if oy 
ts 4 
|A,J=/2 0 -3| = 1(0 + 6) — 2(4 — 2) + 1-12 - 0) =~ 19 
12 J | 
jr -1 4 
JA3]=/2 FO] = 122 - 0) - 2-2 — 4) + 1(0 - 4) = 10 
r 2 | 
Therefore, r= 1A, = 2y¥= |A,| =—] r= |Ay| =] 
|A| My Hl 


Example 3.5 Show that the system of equations 


1o-) 3a 3 


has infinite number of solutions. Hence, find the solutions. 


Solutions We find that 





JA] = |2 
3 


|A,| so 


La BD Ly 
Se ee 
ll 
= 


=f 3 
3 1/=0, 
2 4| 


Le 


1 3 3 jontna 
|Aa| = {2 fi =0; [A= (2 3 2) *9 
7°53 4 ;2°5 


UN w 


Therefore, the system of equations has infinite number of solutions. Using the first two equations 
xX, —~%_ = 3 — 3%; 
Dx, + 3x * 2 — Hy 
and solving, we obtain x, = (1! - 10.x,V5 and x, = Gx; — 4)/5 where x, is arbitrary. This solution 
satisfies the third equation. 


Solu 





= ; 4 9 3 
yale \2 3 1, = 0. IAne 

6 2 

es . 3 Al = 0 and |A2l 
Rrampie 3-7 SOV 

Pe , 2 3) 
. lz 3 -2¥ 
4 7 Az 


tion We find that |A| = 0. 
the first two equations 


: hee 


= — &= where z 15S arbitrary 


we obtain x = 132, ¥ 


Exercise 3.1 


1. Given the matrices Az=|-l 1 


(i) |AB| =|A{|Bi. 
2. if A’ = (1, -5, 7]. B= | 


* % 
" a)? 


3. Show that the matrix A = 


4. Show that the matrix A= 


find A’. 
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6 & 3 4 
> 3 1) =0, JAl=|2 
162 2 


+ 0, the system of equations 15 inconsistent. 


e the homogeneous system of equations 


0 
= |0}. 
t) 


Hence, the given system has infinite number of colutions. Solve 


a ae) a 
This solution eqtisfies the thir equation 


i) 

=—_ 

tana 
LL 


(iu) \A+ Bz\A\7 8B 


3,1, 2]; werify that (A Bi - BA 


2 
| - oe 
4 | sausfies the mattis equion A $A 


N 


1 | 


th 


54 = 0. Hence, find A 


wie = 
2 — 


=_ 


1 2 3) catisfies the mates equalion i GAS + 111 = 0. Hence, 


2 -i 


Land 








ee: ~:~: 
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0 1-l 
5. For the matrix A=|4 —3 4], verify that 
3-3 4 


ij ] mT di tA”). 
(i) [ad (A)]" = adj (A’), (ii) [ad (A)] adj(A -) 


} -2 | 
6. For the matrix A=|-2 3 1], verify that 
LS is 
(i) (AY = (Ay, (ii) (AT) =A. 
2-! i! be 
7. For the matrices A=|-1 2 -I/, B=]! 3.6«C4], verify that 
1 -I 2 zz @.3 


(i) adj (AB) =adj(A)adj(B), (ii) (A+ BY! #A7'+B". 
8. For any non-singular matrix A = (a,;) of order », show that 

(i) Jadj (A)| =|A]"~, (ii) adj (adj(A))=|A\"? A. 
9. For any non-singular matrix A, show that |A-‘| = 1/{/Aj. 


10. For any symmetric matrix A, show that BAB’ is symmetric, where B is any matrix for which th 
product matrix BAB! js defined. 3 ; 


11. If A is a symmetric matrix, prove that (BA~')’ (A°'B')~' = I where B is any matrix for which the 
product matrices are defined. , 


12. If A and B are symmetric matrices, then prove that 
(i) A + Bis symmetric, (ii) AA’ and A’A are both symmetric, 
(11) AB— BA is skew-symmetric. 
13. If 4 and B are non-singular commutative and symmetric matrices, then prove that 
(i) AB“, (ii) A~'B, (iii) A7'B™' 
are symmetric, 
I4. Let A be g non-singular matrix, Show that 
CQ) IPT+A+AT+..+4"=0, then A= At 
(ii) if |-A+A?_... +(-1)"A"=0, then 


IS. Let P, Q and A be non-singular 
16. Ift- 


Atl=(_syuta* 


i Square matrices of order n and PAQ = I, then show that A’! = QP. 
1S 4 non-singular matrix, then show that 


(I-ay! =TP+Atare. 
series on the right hand 
any three non-singular matrices A, B, 


. assuming that the f 
iT. For side converges, 


C, each of order m, show that (ABC)! = c'pat 


iollietietlieatiaiiemeememememeieed —— 





Solve the following system of equation: 


18. 
19. 
20. 
21. 
22. 


yep 
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X+y-z=0. 
jx + 2y + 92z = 14. 


y= yFESZ Wwe sy- t= 4 


x+2y43z2=6, 2c+4ytz=7, 
—-x+y¢22=2, 3x-y +23, ~—¥+ 3¥ +4226. 
Iy—-z=1l, St¥+y=7, y + 3z=5. 


Determine the values of & for which the system of equations 
x-iy+2=0, kx + 3y — kz =0, 3x+y-z= 
has (i) only trivial solution, (11) non-trivial solution. 


Find the value of @ for which the system of equations 
2 (sin &) x+y — 2z=0, 3x +2 (cos 26) y+3z2=0, 5x +3y—2=0 has a non-trivial solution. 


If the system of equations x + ay + az =0, bx+y+bz=0, cx +cy + 2z=0, where a, b, c, are non-zero 
and non-unity, has a non-trivial solution, then show that 


a b c 
i —=-]|. 
l—-b l-—e 


Find the values of A and yw for which the system of equations 








l-—a 


x+2y+2=6, x+4y4+3z=10, x+4y+Az=u 


has (i) a unique solution, (ii) infinite number of solution, (iii) no solution. 


Find the rank of the matmx A, where A is given by 


| 1 2 =a] Pe ele 
26. ” : | a\-1 3 4 25. Biwi by. ll 
3 4 -§5 

ces | 24 5 0 « -& a 

29. Pp q r 30. (a) -Il 2 5 3 (b) —~e| 0 ay b, 

| h a 
p? ¢ 3 2-2 9 4) Hl ae 0 & | 
ay —b, —Cz OQ 


31. 


32. 
33. 


Prove that if A is an Hermitian matrix then iA is a Skew-Hermitian matrix and if A is a Ske 
Hermitian matrix, then iA is a Hermitian martix, 
Prove that if A is a real matrix and A” — 0 as n —> ce, then I + A is invertible. 
Let A, B be n xn real matrices. Then, show that 
(i) Trace (@A + BB) = @ Trace (A) + 8 Trace (B) for any scalars a and B 
(ii) Trace (AB) = Trace (BA), (ui) AB — BA =I is never true. 
If B, C are zn x n matrices, A = B + C, BC = CB and C* = 0, then show that 
APt! = BP [B + ( p+ 1) (C] for any positive integer p. 
Let A = (a,) be a square matrix of order n, such that a, = d, i # j and a, =c, i= 7. Then, show that 
\Al = (c — d)""" [c + (n— 1) dd]. 











ee . wae 
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identrty the following matrices as symmeinc, skew-symmetric. Hermitian, skew-Hermitisn . P 





WOM of theye | properties (axioms) with respect to scalar multiplication 
2 3} fa b | 19 6 c] 6. aa isin V. 
SB -2 S54 37.\6 4 Als mee ee | 7. (a+ BP) a= aart Ba (left distnbutive law) 
{-3 -4 6] le e f) ec ~€ Gf | g. (aB)a = a(Ba). 
9. a(a + b) = aa + ab. (right distributive law) 
[ I 2+4) J-i | | I 2+4i %J-1 | ; 0 2+4) 124 10. la = a. (existence of multiplicative identity) 
: ' + 4j = - | 4 —2 + 4j al 5. . : ' - ; 
” oy -S 3-5}. e.)-2 4 $ 3-3 ; : a The properties defined in 1 and 6 are called the closure properties. When these two properties are 
titi 3+5i 6 [-1-# 3-4 64 “=f  ~3=4 ri | satisfied, we say that the vector space is closed under the vector addition and scalar multiplication. 
: The vector addition and scalar multiplication defined above need not always be the usual addition 
iO i @ 0 -i ter I -j ; | and multiplication operators. Thus, the vector space depends not only on the set V of vectors, but also 
42. | mi 43.{| -§ -2r O |. 44.)-1 0 1-; on the definition of vector addition and scalar multiplication on V- 
ff f Oy i-)+i O i | —i lee 2 if the elements of V are real, then it Is called a real vector space when the scalars a, B are real 
numbers, whereas V is called a complex vector space, if the clements of V are complex and the scalars 
[1 2 =i may be real or complex numbers or if the elements of V are real and the scalars a, 6 are complex 
| Zi -i a, § may 
45. i-2i i 1}. numbers. 
| fo oF Sy Remark 7 
(a) If even one of the above properties is not satisfied, then V is not a vector space. We usually 
3.3 Vector Spaces check the closure properties first before checking the other properties. 
av ; b) The concepts of length, dot product, vector product etc. are not part of the properties to be 
Let V be a“ en a of certain objects, which may be vectors, matrices, functions or some other = satisfied. 
eas a — of F and ts called a vector. The elements of V are denoted by _| (c) The set of real numbers and complex numbers are called fields of scalars. We shall consider 
M iti te — ¥ th ii egovesys operations vector space only on the fields of scalars. In an advanced course on linear algebra, vector 
? ree dition and (ii) scalar multiplication | spaces over arbitrary fields are considered. 
a feet eo oere of (d) The vector space VY = {0} is called a trivial vector space. 
vector addition is defined as - , {diti , . : 
ned as the usual addition of vectors, then The following are some examples of vector spaces under the usual operations of vector addition and 
a+b=(a,, ay, ..., 2) + (by. bo. cis BL) (a; + bj, a5 + by 2. @. bd scalar multiplication. 
If , aCe ee "Eat ye ee , 
the scalar multiplication is defined as the usual scalar muluplication of a vector by the scaler a,then 1. The set V of real-or complex numbers. 
fa Q(a;, a3, ..., a.) ™ (@a,. aa, wa.) 2. The set of real valued continuous functions f on any closed interval [a, b]. The 0 vector 
The set V defines a vector s <5 = ee defined in property 4 is the zero function. 
roperties (axioms) are aia as it for any clements a, b, ¢ in V and any scalars a, § the following 3. The set of polynomials P, of degree less than or equal to n. 
tik | 4. The set V of n-tuples in IR” or C”. 
roperties (axioms) w 
Re ) with respect to vector addition 5. The set V of all m x n matrices. The element 0 defined in property 4 is the null matrix of 
1. a+bisin V order m x n. 
2, a+b=b+a. (commutative taw) The following are some examples which are not vector spaces. Assume that usual operations of 
3. (a+ b)+e=a+ (b+e). | vector addition and scalar multiplication are being used. 
associative | ; , 
4,.a+Q0=Q+a= a. i: am] | 1. The set V of all polynomials of degree n. Let P, and QO, be two polynomials of degree 
Renee (existence of g unique zero element in V ) n in V. Then, aP, + BQ, need not be a polynomial of degree n and thus may not be in V. 
» -a)=0, a ™ Sage -] = A nl 
(€Xistence Se f£ Po =x" + ax" +... + a, and O, = — x" + bx" +... + 5,, 
°¢ of additive inverse or negative vector in V) ae OR : ; ; 


then P, + Q, is a polynomial of degree (n — 1). 
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2. The set V of all real-valued functions of one vanible = magic mud cOMUNUOUS ON the close, 
interval [a, 6] such that the value of the function - has Ss cae CONstan; > 

For example, let f(x) and g(x) be two elements in aa sas ie = 2(6)'= p Sian 

fb) + g(b) = 2p, fix) + g(x) is not in V. Note that p OFMS 8 Vector SPace 
Example 3.8 Let be the set of all polynomials, with real coeficents, of degree n, Where Addition 
is defined by a + b = ab and under usual scalar multiplication. Show that F is not q Vector SPace 
Solution Let P, and Q, be two elements in V. Now, P, + On ~ (P,Q) 1S a polynomial Of degree 


2n, which is not in ¥. Therefore, V does not define a vector space 
Example 3.9 Let V’ be the set of all ordered pairs (x,y), Where x, ¥ are real numbers, 
Lét a = (x), y,) and b = (x3, 2) be two elements in F. Define the addition as 
a + b= (0). y)) + (tp) = (24, — Sy FY YD) 
and the scalar multiplication as 
ax, yv) = (@x,3, ay,/3). 
Show that /’ is not a vector space. 
Solution We illustrate the properties that are not satisfied. 
(i) (pe ¥2) + Cy Yi) = (282 — Sep 2 -— YP PD * > YD) 
Therefore, property 2 (commutative law) does not bold. 
(ii) (x), ¥)) + (Xp ¥2)) + Oy Fy) = (2x, — 3, ¥, — v2) + Oy y) 
= (4x, — 6x, — Jr, ¥, — ¥> — ¥;) 
(Cy. Hy) + (C26 2) + (Xy. D)= C. P) + (Dey — 3x5, > — 5) 
= (2x, — 6x, + 9x;. ¥, — _¥> + Vs). 
Therefore, property 3 (associative law) is not satisfied. 
Hence, V is not a vector space. 


Example 3.10 Let V be the set of all ordered pairs (x, ¥), where +, y are real numbers. Let 
a= (x), ¥,) and b = (x, ¥,) be two elements in FV. Define the addition as 


a+ b= (x, ¥,) + (X> ¥2) = (44, ¥,¥5) 
and the scalar multiplication as 


Otx), v,) = (@x,, @y)). 
Show that F is not a vector space, 


Solution Note that (1, 1) is an : 
ee (1, 1) is an element of V. From the given definition of vector addition, we find 


,¥) +, b= (x), ¥)). 
This is true only for the element (1, 


defined in property 4, '). Therefore, the element (1, 1) plays the role of 0 element 3 
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Now, there exists the element (1/x,, /¥,) such that (x). ¥,) + (i/x, + My,) = C1. 1). The element 
(1/x,. 1/y;) plays the role of additive inverse. 


Therefore, property 5 Is satisfied. 
Now, let a = 1, B = 2 be any two scalars. We have 


(a + B(x. 4) = 3p HY) = BX 3¥D 


and a(x), ¥;) rT Bix, yy) — Idx), ¥y) + 2(X,, vy) = (Xy, ¥)) + (2x, 2y'\) 7 (2x4, 2y5)- 
Therefore, (a + BY(x,, ¥) oa a(x). ¥)) + Blx,, ¥) and property 7 1s not satisfied. 


Similarly, it can be shown that property 9 is not satisfied. Hence, V is not a vector space. 


3.3.1 Subspaces 


Let V be an arbitrary vector space defined under a given vector addition and scalar multiplication. 
A non-empty subset of V, such that W’ is also a vector space under the same two operations of 
vector addition and scalar multiplication, 1s called a subspace of V. Thus. W is also closed under the 
two given algebraic operations on V. As a convention, the vectcr =, 2. - + 1s also taken as a subspace 
of F. 

Remark 8 


To show that Ht’ is a subspace of a vector space V, it is not necessary to verify all the 10 properties 
as given in section 3.3. If it is shown that W’ is closed under the given definition of vector addition 
and scalar multiplication, then the properties 2, 3, 7, 8, 9 and 10 are automatically satisfied because 
these properties are valid for all elements in V and hence are also valid for all elements in I¥. Thus, 


we need to verify the remaining properties, that is, the existence of the zero element and the additive 


Consider the following examples: 


1}. Let V be the set of n-tuples (x,, x, ... x,) in IR” with usual addition and scalar multiplication. 
Then 
(i) consisting of n-tuples (x,, x5, ..., x,) with x, = 0 is a subspace of V. 
(ii) W consisting of n-tuples (x,, x), ..., x,,) With x, 2 0 is not a subspace of V, since W is 
not closed under scalar multiplication (a@x, when ais a negative real number, is not in ¥). 
(iii) W consisting of n-tuples (x,, x>, ..., x,) with x, =x, + 1 is not a subspace of V, since W 
is not closed under addition. 


(Let i= (X1, XN, man x,,) with 5 =x + l and y = Oi, Vo aren Yn) with y> ™ Fi + ] be two 
elements in W. Then 


x yy = (x, FY 5X4 + V2, see Ty sae 
isnotin W as x, + y, =x, +y,+2#x, +y, + 1). 


2. Let V be the set of all real polynomials P of degree < m with usual addition and scalar 
multiplication. Then 


(i) W consisting of all real polynomials of degree < m with P(0) = 0 is a subspace of M. 








om) 
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(ii) ¥ consisting of all real polynomials of degree < m with P(O) = | is not g 


. Subs 
V, since Wis not closed under addition (ifPandQe W,thenP+ Og | Pace of 


i + git Get Be 4 a ece ih 
(iii) W consisting of all polynomials of degree < m with real positive coefficients ie iso, for any scalara,a(f+gy=artager* 
subspace of V since Wis not closed under scalar multiplication (if P js an elemen'* A sisi. W = F + G is a subspace of V. 
W, then—Pe¢ W). | SST oF There 


3. Let V be the set of all n x n real s 


an important result on subspaces. 
multiplication. Then 


: : : j , aw state ' . — 
quare matrices with usual matrix addition and seal We no Cs : v. be any r elements of a vector space V under usual vector addition 
SCalar 5: Ct Vip Va0 eres Tr ae is the set 
heaters ° ‘algplieanon Then, the set of all linear combinations of these elements, that 1s 
‘ mm = . ‘ E 


of all elements of the form 


(i) W consisting of all symmetric/skew-symmetric matrices of order n 


1S a Subspace of p 
(ii) ¥ consisting of all upper/lower triangular matrices of order 7 is a 


subspace of Vv 


i QV, + QzVz +... + a,V, et 
(iii) W consisting of all n x m matrices having real positive elements is not a subspace of y | ; a 
since W is not closed under scalar multiplication (if A is an element of w is a subspace of V, where @,, @, -... @, are scalars. 
then—Ag¢ PW). 


4. Let V be the set of all » x n complex matrices with usual 


matrix | rery elem in ¥ be 
ing set Let S bea subset of a vector space V and suppose that every element in P’ can 

atrix addition anq Scalar Spann 

multiplication. Then 


: - : mg set 
obtained as a linear combination of the elements taken from S. Then S is said to be the spanning 
alt 


for V. We also say that S spans V. 
(i) W consisting of all Hermitian matrices of order n forms a vector 





serie ; | - 
Space when SCalars ample 3-12 Let V be the vector space of all 2 x 2 real visttrices. Show that the se 
are real numbers and does not form a vector space when scalars are complex numbers ai e 
(#'is not closed under scalar multiplication). l 0) (oO I1\)(0 Oo ' 0 
S=) ; 1) Oe 3 
a <x+iy (1) 0 oOo) \O0 O 
Let A= Nad ew. 
i i OMA ait 2p fol 
ai xxi-y (ii) silo aoflo OF kk oa). 1 
Let a=i. Weget aA=iA= e W. xg" 
| x+y bj 


span V. 
(ii) W consisting of all skew-Hermitian matrices of order 7 


forms a vector space when 
scalars are real numbers and does not form a vector space when scalars are complex 
numbers. 


i x+fr 
—K+iy 2 


a b 


Solution Let x= | be an arbitrary element of V. 
c 


(i) We write 


Eb IG dd 


: Se se , 
Since every element of V can be written as a linear combination of the elements of 5S, the se 
S spans the vector space V. 


Let @=i. We get ia-[ i “yew 
“IX-yp 2 
Example 3.11 Let F and G be su 


bspaces of a vector space V such that FA G = {0}. The sum of 
F and G is written as F + G and 


(ii) We need to determine the scalars @,, G@, 03, @ SO that 
is defined by 


E al-abe alsefo cre lt 


Equating the corresponding clements, we obtain the system of equations 


F+G={f+pfe Fig ¢€ G}. 
Show that F + G is a subspace of assum'ng the usual definition of vector addition and scalar 
multiplication. 


Solution Let ¥=F+G andfe F, &€ G. Since 0 € F, and0 € G we have 0+ 0=0€ VW. 


a, + & + a, + A, 4, Gy +O; + a, = b, 
Let f, + g, and f, + g, belong to W where f ,f, © F and g,, £,¢€ G Then 


a,r a= Cc, a, = d. 








r , ae 
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The solution of this System of equations is 


a, = a, @=c -d, G@, =b-e, 
Therefore. we can write 


ab 10 Ei } 1] 1 | 
= _ + = +(c-—d 
b ;] (a a a (b lg 3 ( ie o| 4), | 


L 


Since every element of V can be written as a Jinear combinanon of the eleme 


nts 
set S spans the vector space S Of S. the 


m Whether o, 
not the set ila <n as 


7 
See t+age ersten 


spans ’ ? 


Solution Let P(1) = at? + Br? + yr + 5 be an arbitrary element in I. We need to find whether 
not there exist scalars a,, a5, a, such that si 
an? + Br + yt + 5= a, + ay(t? + 2) + at + 2+ 1) 

ar + Br + yt + d= (a, +a) + ar + (a, + a3) f + ay. 


Comparing the coefficients of various powers of 1, we get 





a, +a; a, a,=B, ag+a,=y% a= 
The solution of the first three equations is given by 
: a,-at+tB-y a,=f, a,=y-B 
ee Fe Substituting in the last equation, we obtain y— B = 8, which may not be true for all elements in FV. 
* oy . For example, the polynomial ¢° + 217 + 4 + 3 does not satisfy this condition and therefore, it cannot 


be written as a linear combination of the elements of S. Th 
Space F. 






erefore, 5S does not span the vector 


Linear Independence of Vectors 


é r, a? Br iate ict EHOISP ee nite set {Vj, v2, -.., ¥,} of the elements of V is said to be /inearly 


a Oy o.. @,, not all zero, such that 


Wit eet anyy O's oho > aint 3 
ss PK % = 0, then the set of vectors is said to be Jinearly 
peek Ear Sete Le = 2 

+ : i ay “* | + 


Poh. ae ek Sg, u ‘> i 4 _ 
: : ; | et "7 Te ek, ey ; - | 
pe a Pipe acs bs Yar so Yq cam be written alternately as follows. = 





(2 ~» Vn} 18 Tinearly dependent if and only if at least one 





i 
rng 
#4 


¥ 
a 
-INer iS a a} 2 
ae nts. LS gor ea lee 
* - .. ® - by 
* a z- " a «4 





: Ea. (3.17) gives 
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Remark 9 a homogeneous system of algebraic equations. Non-tnvial solutions exist if 


‘ent matrix) = 0, that is the vectors are linearly dependent in this case. If the det(coefficient 


det(coeftic c "s rule, @ = @ = --. = &, = 0 and the vectors are linearly independent. 


matrix) * 0, then by on 
Example 3.14 Letv, =, “1, 0), Vv, = (0, 1, —1) and v, = (0, 0, 1) be elements of IR“. Show that 
the set of vectors {v,. ¥z, V3} is linearly independent. 
Solution We consider the vector equation 
a@,v, + @2,V, + a3v; = 0. 
Substituting for v,, V2. V3, We obtain 
a,(1, -1, 0) + a,(0, 1, -— 1) + a,(0, 0. 1) = 0 
or (a, — & + &, — G+ 2) = 0. 
Comparing, we obtain a = 0, — a + a = 0 and — @ + a= 0. The solution of these equations 
is a, = = % =O. Therefore, the given set of vectors is linearly independent. 
Alternative 
J 0 0 
det(¥,, V2, V3) = |-1 1 OJ =120. 
0-1 1 


Therefore, the given vectors are linearly independent. 


Example 3.15 Let v, = (1, —1, 0), v2 = (0, 1, -1), v3 = (0, 2, 1) and v, = (1, 0. 3) be elements 
of IR?. Show that the set of vectors {v, v, v3, V4} is linearly dependent. 


Solution The given set of elements will be linearly dependent if there exist scalars @,, G+, @,. Gy, 
not all zero, such that 
ayy) +r Q3V3 + a.¥3 + Ov, = 0. (3.18) 
Substituting for v,, V2, V3, ¥4 and comparing, we obtain 
The solution of this system of equations is 
@=- a, @&= 5a,/3, a, = -—4a,/3, a, arbitrary. 
Substituting in Eq. (3.18) and cancelling a, we obtain 


4 
vj +2 ¥2-Fwtwn 0 


Hence, there exist scalars not all zero, such that Eq. (3.18) is satisfied. Therefore, the set of vectors 
is linearly dependent. 





a a 


a fa : = ‘ ; 
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33.3 Dimension and Basis 





¢ There exis 


ts an element 
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r independent. 
can Wey Vewy BFE linearly 1 


‘ WV 
. i combination of the vectors V}. V2- ---» “k 
be written as 4 jinear lfin>k+ 1, we keep adding 


Let F be a vector space. If for some positive integer m, there exists a set S of t linearly prom” ___ewery element of V can : ent can be continued. 
elements of F and if every set of 5 - “TY Indepeng erwise: - ension k <n. This argum : 
and if every set of n + | or more elements in Fis linearly dependent, then ae oth erefore V has dime pak. Egy ween Ma basis of V. 
to have dimension n. Then. we write dim (V) =n. Thus, the maximum number of linearly inde 'S Saig gnd th aman Vee v,, such ip : + can be represented as linear combinations 
elements of I ts the dimension of |}. The set S of n linearly independent Vectors ic i i eleme” —* of a vector space V of amewae Slab ote ois for the 
basis of F. Note that a vector space whose only clement is zero has dimension zero. Cd the since all seats in the basis of F, the basis of V spans Y. ae 5 i the following set of vectors 
the n cle” sider the vector space IK . , : 
Theorem 3.3 Let J’ be a vector space of dimension nm. Let v,. v.. .... v, be the linearly indepe mee yector space: For example, con 
elements of V. Then. every other element of I’ can be written as a linear combination of ae sai 1. 0}, (0, 1. -1): (0, 0, 1) 
slements. Further, this representation is unique. Miss Oey oy, (0, 0, 1) fl, 23) 
. == 1, —|, +. 4 . id ¥ = 
f Let v be an element of }, Then, the set {v. ¥). .... ¥,! is linearly dependent ag jt His Gi) [ 0, 0}, (0. 1. 0}, [0, 0, 1) ai . 
elements. Therefore. there exist scalars a, @,, .... @, not all zero. such that id Gi. Eee basis in IR°. Some of the standard basis are tne 
. jnearly independent and therefore forms a basis . 
anv + a,v, + ... + av, = 0. linest 
0 tal nYn (3.19) nee 


. 7 _ a = : . ; ;: = 1 Pa t A ar \ 
independ ent, we get a, = a, =... = @, = 0. This implies that the set of n + 1 elements y ae 
v, 1s linearly independent. which is not possible as the dimension of V is n. Es 


Therefore, we obtain from Eg. (3.19) 


v= 2 © aloo, (3.20) 


i=] 


Hence, v is a linear combination of 7 linearly independent vectors of F. 
Now, let there be two representations of v given by 





V= 2,V, + av, + ... t+ av, and v= bv, + bv. + ..+ by. * 


where 5; # a; for at least one i. Subtracting these two equations, we get 
= (a, = Ay, ‘7 (a3 — b3)v¥> eerie af: = ee 
Smnce V,, ¥>, +++ V, are linearly independent, we get 


a,-—6,=0 or a= 6, i= 1, 2, ....7 


Therefore, both the representations of v are same and the representation of v given by Eq. (3.20) 





1. 1f V consists of n-tuples in IR", then 


e, = (1, 9, 0, .--. 0), e, = (0, 1, ---. Oh... 8, =U, 0: =, 0; 7) 


is called a standard basis in IR”. 


2. If V consists of all m * n matrices, then 


o|, r=1,2, --..m and s= 1,2, ---." 


a 


B= [0 wa 1h sm 


oo 
° 
° 


i 5 1 led its 
where 1 is located in the (r, s) location, that is the rth row and the sth column, is cal 1 
standard basis. 
| xx \° © ©\in ¥ can be 
For example, if ¥ consists of all 2 x 3 matrices, then any matrix oo 


(8) A set of vectors containing 0 as one of its elements is linearly dependent as 0 is the linear ito Gl. 19). 'o 
, where En“lo o of 2? 1o 0 o| 





al_vector space. If v,, v>, -.., vj, k <n are linearly 
elements ¥,. 15 ¥i5.35 --+) V, Such that {V,, V2, ---» Yah isy) 


pe 2 « 


Example 3.16 Determine whether the following set o 





3. If V consists of all polynomials P(r) of degree = n, then {l, r, f°, --., "} 1s taken as US 


standard basis. 
f vectors {u, v, W} forms a basis in IR”, where 
(i) u = (2, 2, 0), v = G, 0. 2), W = (2, -2, 2) 

Gi) u=(0, 1.-, v= ©). 0-1, w= G, 1 3). 
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Solution’ If the set {u, v, w} forms a basis in IR*, then u, Vv, W must b 


; SMR indenende 
Let @, >, @ be scalars. Then, the only solution of the equation At. 


au + av + aw = 0 G2) 
must be @, = a, = a; = 0. 
(i) Using Eq. (3.21), we obtain the system of equations 
2a, +3a,+2a,=0, 2a@,-2a@,=0 and 2a, + 2a, = 0, 


is are linearl, 
independent and they form a basis in IR’. y 


(ii) Using Eg. (3.21), we obtain the system of equations 
‘— & + ja, = 0, a, + @, = 0, and — @ — @ + 3a, = 0. 


The solution of this system of equations is a, = Q = a = 0. Therefore, u, V, W are linearl 
independent and they form a basis in IR?. y 
Example 3.17 Find the dimension of the subspace of IR* spanned by the sct (1000), (019 0) 
(1 2 0 1), (0 0 O 1)}. Hence find its basis. . 


Solution The dimension of the subspace is < 


4. If it is 4, then the only solution of the vector 
equation 





@(1000)+a,(0100)+a,(1201)+a,000 1)=0 


(3.22) 
should be a, 


= @, = @; = @, = 0. Comparing, we obtain the system of equations 
@+a,=0, a&+2a,=0, a, + a, = 0. 
The solution of this system of equations is given by 
= G4, 0 = 2a, OO =— a,, where @, 1s arbitrary. 
Hence, the vector eq 


uation (3.22) is satisfied for non-zero values o 


; : f @), GQ), @;, and a. Therefore, 
the dimension of the set is less than 4. 11 9, OQ}, and Oy refore 


Now, consider any three elements of the se 


t,say(1 000 
vector equation y ( ),(0 1 0 0) and(1 2 O 1). Consider the 


@(1000)+a,01006)+a,(1 20 1) = 0. 


(3.23) 
We obtain the system of equations 


Comparing, 

@ + @,~ 0, a2, + 2a, 

‘hh Thaw, es = wrlasaghod ~ 2 ~ G@;= 0. Hence, these three elements are linearly 

(1.0.00), 100), (1 9 Grr the given subspace is 3 and the basis is the set of vector 
7 ( 2 0 J}. We find that the fourth vector can be written as 


00 1)=(1000)-2¢ | 00) + 1(1 20 1), 


= (0 and a, = 0. 


EE 


Ne 
—E 
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ple 3.18 Letu~ \(a b. c, d), such that a + ¢ + d = 0. b + d = 0} be » subspace of IR*. 
Exam . + Oe al 
ae the dimension and the basis of the subspace. 

lution uw satisfies the closure properties. From the given equations, we have 
Solut 

a+ec+d=0 andb+d=0 or a=-— ¢c=—d and b= - Jd. 

‘e two free parameters, say, ¢ and d. Therefore, the dimension of the given subspace is 2. 
ps ae « = 0.d=1 and c = 1, d = 0, we may write a basis as {(-1 -1 O 1), (-1 0 1 O)}. 

hoos =U, 
3.3.4 Linear Tranformations 


A and B be two arbitrary sets. A rule that assigns to elements of 4 exactly one element of B is 
es da function or a mapping or a transformation. Thus, a transformation maps the elements of 4 
cnn clensentz of B. The set 4 is called the domain of the transformation. We use capital letters 
rs etc. to denote a transformation. If 7 is a transformation from A into B, we write 

T:A—> B. (3.24) 


For each element a € 4, we get a unique element be 8B. We wnte b = 7(a) or b= Ta and b is called 


- the image of a under the mapping T. The collection of all such images im B is called the range or 


the image set of the transformation Tf. 


In this section, we shall discuss mapping from a vector space into 4 vector space. Let V and WH’ be 
two vector spaces, both real or complex, over the same field F of scalars. Let T be a mapping from 


V into |, The mapping T is said to be a /inear transformation or a linear mapping, if it satisfies the 
following two properties: 


(i) For every scalar @ and every element v in F 


Tiav)= aT(v). 


(3.25) 
(ii) For any two elements v;, ¥> in V 


Mv, + v.)= T(v,) + T(v,). (3.26) 

Since V is a yector space, the product @ v and the sum v, * ¥, are defined and are elements in F. 

Then, 7 defines a mapping from F into H’. Since P(v,) and T(v.) are in W, the product a 7(v) and 

the sum 7(¥,) + T{v2) are in W. The conditions given in Eqs. (3.25) and (3.26) are equivalent to 
Mav, + By) = Tlav,) + Tiav.) = @7(v,) + BTC, 

for v, and v, in V and any scalars a, B. 

Let V be a.vector space of dimension » and let the set iV). ¥y. -... ¥,,} be its basis. Then, any 

element v in V can be written as a linear combination of the elements Min Vig nc0a Mig 

Remark 11 

A linear transformation is completely determined by its action on basis vectors of a vector space. 

Letting @ = 0 in Eq. (3.25), we find that for every element v in F 


T(Ov) = T(O) = OF(v) = 0. 








Le) 
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Therefore. the zero element in 


| iS mapped into zero element in W’ by the linear 
The collection of all elements w 


transfo : 
= (v) is called the range of T and is written a ee 


of all el : , 5 ran(T ae 
ie ersments of ¥ that are mapped into the zero element by the linear transformation ». The Set 
erne! or the null-space of T and is denoted by ker(7T). Therefore, we have 'S Calleg 


ker(T)= (¥ | f(v) = 0! and ran(T)= iTiv) | ve Vy. 
Thus, the null Space of 7 is a subspace of FV and the range of T is a subspace of Jy 
: td, 


Called the ny}; 
We have the following result. ee 


of T. 

Theorem 3.5 If 7 has rank r and the dimension of F is n, then the nullity of Tis » — r, that is 
rank (7) + nullity = » = dim (V). 

We shall discuss the linear transformation only in the context of matrices. 


Let A be an m x 7 real (or complex) matrix. Let the rows of A represent the elements in [R" (or 
and the columns of A represent the elements in IR™ (or C™). If x is in IR”, then Ax is in IR™ a 
an mx m matnx maps the elements in IR" into the clements in IR™. We write spi 


T= A: IR"+> IR", and Tx = Ax. 
The mapping A is a linear transformation. The range of 7 is a linear subspace of IR” and the kere] 
of 7 is a linear subspace of IR". 


Remark 12 


Let 7, and 7; be linear transformations from V into W. We define the sum 7; + 7; to be the 
transformation S such that 


Sv = Tv + Toy, ve F. 
Then, 7, + 7} is a linear transformation and += 7) +7). 


Example 3.19 Let T be a a linear transformation defined by 


] —l 


] } 
| 0 | 
A Deel Ae J-fab de -[al ae 9-(3) 
3 : , I. {5 3 


3 
4 
Find 7}{ Ik 
43.8 


, oa 
Solution The matrices ol Sale dei alli’ 
BPs LEP. 210 ° 1. 


basis in the space of 2 x 2 matrices. We write for any scalars @,, @, Q, Q,, not all zero 


are linearly independent and hence form 4 








Matrices and Eivenvalue Problems 3.3\ 
0 0 0 Oo 
asi" IA idl SEE rom j 
(3 s\= (| + af ul” ht ak OM he 


a, a, +a, | 
= ‘ 
a, +a, +a, aQ,+0,+@,+a, 


the elements and solving the resulting system of equations, we get a, = 4, a, = I, 


companne = §. Since T is a linear transformation, we get 
9 aaa 4 
i 1 0 0 0 0 
4 5 = | ee " | + a r\( \ 
“(; : ils ( i wee r 4 ee ( ) DANO Ay 
] i j —1 —2 
= 4/2] + 1] -2] —2/-2] + 5| 2] =] 20). 
3 3 -3 3 36 


T 2 
Example 3.20 For the set of vectors {x,, x,}, where x, = (1, 3)", x, = (4, 6)’, are in IR’, find the 
matrix of linear transformation T : IR? — IR’, such that 
Tx,=(-2.2 -7)" and Tx,=(-2 —4 -10)’. 


a , . P * ‘ 4 S 
Solution The transformation T maps column vector in IR? into column vectors in IR“. Therefore, 
T must be a matrix A of order 3 x 2, Let 


a, 5, 
A=|a, 4 
a, b, 
Therefore, we have 
a 6, 1 —2 ay Dt [4] _ rs 
a >2||;|- 2| and @ hil <|=| —4}- 
ay b, 5 —7 a, b, —10 
Multiplying and comparing the corresponding elements, we get 
a, “- 3b, = —2, 4a, = 6b, = —2, 
: @, + 36, = 2, 4a, + 6b, = — 4, 
Solving these equations, we obtain 
1 -l 
A=|-4 2 
2-3 
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i “ - ; = i> = z 
Example $21 Lett bea linear transtunnation from IR° into IR->, where 


l 
x= Ax A= re 


Seludin “To find ker 7), we ‘need tocdeiennine all v= (v) 7 


Tv =Av=0 Bives the equations 
Vv, +7, = 0, Dy? ay 
Whose solution is 0, = — Vv, = 0, Therefore v =i, [1 —1 ie 


Hence, dimension of kKer(T) is 1. 
Now, ran(7) is defined as {7(v) | ve Fi. We have 


Dy 
| Jt 8 i +25 
Tiv) = AV = i's ‘ 
-!| 0 l q =i) + its 

ily 


: | I 0) 
Since = = 6)” i} the dimension of ran( i) 1s 2, 


Example 3.22 Find the matrix of a linear transformation T from IR? into IR° 


| 6 \ 2 l\ (6 
Petl= 26 Fp-1l=;-+4a] zl—o |= 6 |, 
4 2 | 3) (5 


Solution The transformation T ma 


| ps elements in IR? into IR?. Therefore, the 
matnix of order 3 x 3. Let 


this matrix be written as 





a) 9 rk , Raa Fa =)". Find ker(T), ran(T) and their dimensions, 


; i 
OY such thay ry 


= ) Now 


such that 


transformation is a 


a @, a, 
r=A= B, B,; By}. 

Ye Fo Fs 

We determine the elements of the matrix A such that 
@ @ a,/fl 6] ja, a, co ON em ee ai] I! |6 

[Pe i= i2h 16, A Bll-il-lal la pp ll-olelel 
3 1 ONS (ae 2 Y3 ji | 4h 1%. ¥s Y3JL 3) [5 
: an at folving the resulting equations, we obtain 











Matrices and Eigenvalue Prohlems 3.33 


(2 2 
A=|-15/2 3 13/2\. 
1 | 2 


ple 3.23 Let Tbe a transformation from IR* into IR' defined by 
Examp " 
T(x), Xz, X3) = xi + ce + x3. 
Show that 7 is not a linear transformation. 
: 3 
Solution Let x = (%), 42 x) and y = (jj. ¥2, ¥3) be any two elements in IR“. Then 
x + y= (xy + Yy- X2 + V2, ¥3 + V3): 
We have , 
Tix)=xhtxhtxy. My) =i tyrt+ ys 
T(x + y) = (xy +») + (2 + ya) + Os + ys) # T(x) + TY). 


Therefore, T is not a linear transformation. 


Matrix representation of a linear transformation 


We observe from the earlier discussion that a matrix A of order m xn is a linear transformation which 
maps the elements in IR" into the elements in IR”. Now, let T be a linear transformation from a finite 
dimensional vector space into another finite dimensional vector space over the same field F. We shall 
now show that with this linear transformation, we may associate a matnix A. 


Let V and W be respectively, n-dimensional and m-dimensional vector spaces over the same field F. 
Let T be a linear transformation such that T: V — W. Let 


SE (Vey Vie acne Vel ¥ LW yy Whe es WH) 


be the ordered basis of V and W respectively. Let v be an arbitrary element in V and w be an arbitrary 
element in W. Then, there exist scalars, a@,, a. ..., a, and’ B,, Bs, ..., B,,, not all zero, such that 


V= @v, + @yv, + ... + @,V, (3.271) 
w= Bw, + Bw, +... + Bw,, (3.27 ii) 
and w= Tv = T(a,v, + aov, + ... + @,v,) 


= a,Tv, + a@,Tv, + ... + Ty, (3.27 iii) 


Since every element Tv,, i= 1,2, .... is in W, it can be written as a linear combination of the basis 


vectors W,, W2, --., W,, in W. That is, there exist scalars a,, i= 1, 2, ....1, j= 1, 2, ..., m not all 
zero, such that 


Tv,;= a,;W, 2 >;Wy> ese FF yj Wy 


= [Why Wye noe Wel [Gin Gap ---3 Qusl's f= 1, 2, 000% (3.27 iv) 
Hence, we can write 
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4 B = (bi) be wwo matrices each of order a xn such that 
a) a> ad), A - (ay) an Root | _ B 
g a3). @ a pet rx=yA and Tx = y5. 
(V1, Vag ss Vp] = [Way Woy <ver Wall 2) 2m =f 
2 7 v) we have 
re, 
Ip, pz Baap gherefo yA = yB 
or 
x= yA mr ad — 
: i=l 
or - : = ee | 
w,.) is a given basis, we obtain a; = 5; for all i and j and hence A = B. 
oe ig since vim [Ws Wee 
i | : 
A= 721 Y ee 4 Let T: IR? = IR be a linear transformation defined by 
(3.27 vi) example 3.2 
Imi m2 mn ms yi 
si al (; = §} 
TeSpect to the Zz 
linear transformation 7, with respect to the ordered basis 


termine the matrix of the 





The m x n matrix A is called the matrix i 
mati Tix representation of 7 or the matrix of T wit 
at basis . ang y. It may be observed that x is a basis of the vector space vy, . whi 
ys the basis of the vector space #’ that contains the range of 7. Thetefiire la 7 acts 
i aa of 7 depends not only on 7 but also on the basis x and y. For a es matrix De 
basi rmation 7, the elements a, of the matrix A = (a) are determined from (3.27 v), usin ‘ near 0 
is vectors in x and y. From (3. 27 iii), we have (using 3.27iv) is a A by ae gee eee "| in IR* 
i Mesa ale eo ‘ (i) x= 0 ] 0 in an ¥ 0 | 
pay) Wy 21W +... + ag We) + Aa W, + aw, +... + a2W,) 0) \o 1} 
SP dr + : : ote 
ou, nly.) @2,Wz tT ... + 2anWm) (standard basis €,, €2, €3 in IR? and €), €3 in IR*). 
= (Ga, + Qa), +... + G,4j,) W, + (O42, + ay + ... + a a,,)w, 
+ cs + } sa a : 
(Gy a_1 + Oz Aqgt .-. + Byam) Mm Giy x= 4)1/Oh| 1p im IR? and y= (ih } in IR. 
= Bw, + 2iw, - i. + B.Win ot ta | 0 ] -l 
where B; = aa), + @5a,, +... + | 
EE REE ER Eg eae Solution Let V = IR?, W = IR. Let x = {¥j. Yo. V3}o ¥ = {Wis Wal 
B, ay) M3 cee) 6&1 p a, l 0} 0 1 0 
Hence, B: fs #21 43> «+. >, as (i) We have = 0}, v,= l wa 0 |, w, = (o} Ws = (°} 
: (0 0, 1) 
or , ’ | 
| =Aa : : N+ 
sliced sedate c We obtain T|0| = (ol (0) + ("| (0), T)1)|= (H(t, (1), 
en matrix A 1s as defined in (3.27 vi) and ! 0 ap XS 0 | 
= T RY | 
& [B,, A, arr B.] , &= [@,, 7 OR ml". 0 
rlol=( ‘|=|. ay+(} !) 


y of vector spaces V and W respectivély, and a linear 
at is Tx = yA, we write 


btained from (3.27 v) is unique. We prove this result as 


For a given ordered basis vectors x and 
transformation 7: V — W, the matrix A o 


follows: 


Using the notation given in (3.27 v). th 





SE SESE 
slain Se ee er 


= i j 
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T [v,, V2, V3] = [Wy, Wo] hi I ] 


0 |] -I 
If1) (0) fo | 
hott lol= [oko +] 
| oy ist] -I} 
07 LO} (I ees 
Th : . 
5 erefore, the matrix of the linear transformation T with respect to the given basis ve ; 
Clors js Biven 
a-|f I ] 
ot -—- 
. 0’ ] I 
I l 0 : Af 
0 = 3 I , 
We obrain ryilj={ J= ; =i ' af 
toy OF gle Flop [| l feos! le 
é mn! 
I l 
l 
‘ a 
Using (3.27 v), that is Tx = YA, we write 
O)/1)f1 
| }fl l 
| -I/]j1 
P/ ql 0) | me 
Therefore, the matrix of : itl 
re x of the linear transformation T with respect to the given basis vectors is given 
I 
ee 0 | 
cE OF 
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Exercise 3.2 
Discuss whether defined in proble 


i tisfied. 
ich of the properties are not 5a — | 7 
- polynomials of degree S m and having ? as a root with the usual addition 


ms 1 to 10 is a vector space. If Fis nol a vector space, state 


1. Let V be the set of the real 
and scalar multiplication. | ” 
4. Let FV be the set of all real polynomials of degree 4 or 6 with the usual addition and scalar 


multiplication. a3 bene ae, 
3. Let V be the set of all real polynomials of degree 2 4 with the usual addition and scalar multiplication. 


4. Let F be the set of all rational numbers with the usual addition and scalar muluplication. | 
5. Let V be the set of all positive real numbers with addition defined as x + y = xy and usual scalar 
multiplication. 
6. Let V be the set of all ordered pairs (x, y) in IR? with vector addition defined as (x, y) + (u, v) = 
(x + u, y+) and scalar multiplication defined as a(x, y) = ax, yp). 
7. Let V be the set of all ordered triplets (x, y, z), x, », z © IR, with vector addition defined as 
(x, ¥, Z) + (u, v, w) = (3x + 4u, py — 20, 2 + w) 
and scalar multiplication defined as 
a(x, y, z) = (ax, ay, az/3). 
8. Let V be the set of all positive real numbers with addition defined as x + y = xy and scalar 
multiplication defined as ax = x*. 
9. Let F be the set of all positive real valued continuous functions fon [a, 6) such that 


(i) [. J (x)dx = 0 and (ii) i f(x) dx = 2 with usual addition and scalar multiplication. 
10. Let V be the set of all solutions of the 
(i) homogeneous linear differential equation y” — 3)" + 2y=0. 
(11) non-homogencous linear differential equation py” — 3y’ + 2y = x. 
under the usual addition and scalar multiplication. 
Is W a subspace of V in problems 11 to 15? If not, state why? 


11. Let y be the set of all 3 x | real matrices with usual matrix addition and scalar multiplication and W 
consisting of all 3 x 1 real matrices of the from 


a ‘ a a a 
(i)} 6 |, (ii) | a |, (iii) |b], (iv) ||. 
a+b a” 2} 0 


12 . Let V be the set of all 3 x 3 real matrices with the usual matrix addition and scalar multiplication and 
W consisting of all 3 x 3 matrices A which 


(1) have positive elements, (ul) are non-singular, 


(iii) are symmetric, (iv) A7=A. 
13. Let VF be the set of all 2 x 2 complex matrices with the usual matrix addition and scalar multiplication 
and W consisting of all matrices with the usual addition and scalar multiplication and W consisting 


z x + iy 


gs | 


numbers, (ii) scalars are complex numbers. 
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14. Let ¥ i 7 

paliiene a real Polynomials of degree < 4 with the usual polynomial 

is icatio consisting of polynomials of degree < 4 having 

(1) constant term 





bi (ii) coefficient of £7 as 0, 

(11) coefficient of r} as 1, (iv) only real roots. 
<e F be the vector space of all triplets of the form 
multiplication and W be the set of tiplets of 


1S. 


(=). 45, 2;) in IR? with the usual add 


itio 
the form (x,, x3, x;) such that "and scalar 
()x,= 2x, = 3x;, 


(11) Fy) a aS + l, 
(iv) x, txatxi <4. (v) x, is an integer. 


4, 4) and w=(1, 5, —3). Determine whether or not x 
is given by 


(ii) x, > 0, Xz, X; arbitrary, 
16. Let a =(1, 2, -1), v=(2, 


of a, vy W, where x 


(1) (4, 3, 10), (ii) (3, 2, 5) (iii) (—2, 1, -5). 
17. Let w= (1, -2, 1, 3), v = (1, 2,-1, 1) and w= (2, 3, | 
combination of u, v . w, wher 
(1) (3, 0, 5, -1), (ii) (2, -7, 1, 11), 
18. Let P,(s) = 27 ~ 47 — 6, Pi) = or? 77 ~ 
Pt), P(t), when 
(i) P(t) = —17 + 1, 


(ut) (4, 3, 0, 3). 





(ii) P(t) = 247 — 34-25. 
19. 


Let V be the set of all 3 x | real matrices. Show that the set 


1 1) fo 


O/; spans F, 
0); | O I 


20. Let V be the set of all 2 x 2 real matrices. Show that the set 


soe ohh atlratleec ¥ 
hi =< erry lo ee 


21. Examine whether the following vectors in IR*/C? are linearly independent. 
(1) (2, 2, 1), (1,1, 1), (1, 0, 0), (ii) (I, 2, 3), (3, 4, 5), (6, 7, 8), 
(111) (0, 0, 0), (1, 2, 3), (3, 4, 5), 


(iv) (2, I, —| ). (I, =, t), (2i, =I, 5), 
(v) (1, 3, 4), (1, 1, 0), (1, 4, 2), (1, -2, 9). 
22. Examine whether the following vectors in IR‘ are linearly independent. 
(1) (4, 1, 2, -6), (1, 1, 0, 3), (1, -1, 0, 2), (-2, 1, 0, 3), 


(ii) (1, 2, 3,1), (2, 1,-1, 1), (4, 5, 5, 3), (5, 4, 1, 3), 
(iit) (1, 2, 3, 4), (2, 0, 1, -2), (3, 2, 4, 2), 


(iv) (1, 1,0, 1, (1, 1,1, D, 1,-1, 1. D, (1, 0, 0, 1), 
(v) (1, 2, 3, -1), (0, 1, -1, 2), (1, 5, 1, 8), (-1, 7, 8, 3). 


23. If x, y, z are linearly independent vectors in IR?, then show that 
(QQxtyy+2z,z2+x: 


(ii) xX,xt+y,x+y+z 
are also linearly independent in IR?. 


24. Write (— 4, 7, 9) as a linear combination of the elements of the set S: {(1, 2, 3), (- 1, 3, 4), (3, I. 2)}. 
Show that 5 1s not a spanning set in iR?, 


addition and Sea} 
ar 


is a linear combination 


» —1). Determine whether or not x is a |ir, 
¢ x is given by sss 


8, P3(t) = 21 — 3, Write P(r) as a linear combination of Pia 
ays 
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S: 3 te Des By. 
> 4,4 | as a linear combination of the clements of the set 5: oS . et She 2}. Show 
15. der! . “ke spanning set for all polynomials of degree 2 and can be taken a5 1 ; 
that + : : 


t of all vectors in ip? and § be a subset of I’ consisting of all vectors of the form 
Be. EE ; - aw ae (ii) (x. ¥. z. Ww) such that x+y+z-w=0, 
(1) x.y: —y, ak Pig : 
(iii) (x, 0, 2.) — ag (x, *, x, X)- 
i he dimension and the basis of 5. .. : 
em values of k do the following set of vectors form a basis in IK” ? 
4. For ™ 
(i) {(k, 1 —k, k), (0, 3k -— 1,2), CA 1, 0)}. 
(i) {(& 1, 1), @, 1.1, & 2, k)}. 
(iii) (Ck, & 4), (0, &, 1, (A 9: k)}. 
\ = -1, I}- 
iv) iq, k, 5), (i, 3, 2), (2, + | jatiteg 
at the dimension and the basis for the vector space V, when V is the set of all 2x2 (1) — eS wl 
28. ii) symmetric matrices, (li) skew-symmetric matnces, (iv) skew-Hermitian — 
eee A = (a,) with a,, + ay; = 0, (vi) real matrices A = (a,,) with ay, + 4)2 : Ase B58 
9g. Find the dimension and the basis for the vector space ¥. when F is the set of all 3x 3 (1) diag , 
29. matrices (ii) upper triangular matrices, (iii) lower triangular ise2.0«¢s. clara 
30. Find the dimension of the vector space V, when V is the set of all nm x mn (i) real matnees, 
matrices, (iii) symmetric matrices (iv) skew-symmetric matrices. 


* = r . . a wh 
Examine whether the transformation T given in problems 31 to 35 is linear or not. If not linear, state why? 


31 rim? oR! 7) =a +y + aa # 0, real constant 
_T: ; 
Jr aa 
, i: 4 
32. T:1R°? 3 1R?; Tly -(.%,} 33. T: IR! > 1R?; TO) ‘ 
Iz 
0 x#0,~40 (x 
34. T:1R2 3 1R': TI" | =42y, x=0 35. T: IR? 3 IR': Tl y| = xv tx +z 
e 3 y= () z 
x, y=0. 


Find ker({T) and ran(7) and their dimensions in problems 36 to 42. 


2x + 
x x+y b ; : ; 
; * a 3 = ; . 
36. T: IR GIR? Tl yl =| =z |- 37. T: IR" - IR . ; 
z x-y 3x+4y 
‘ x+y+w : 
: IR? i. =x + 3y. 
38. T: IR‘ > IR’; T : - Zz i. 39. T: 1R° > IR; r(*) y 
| yt2w 
w 
x 


40. T:1R? a IR's T)y| =x 7 3- 


bl 
= 


41. T: IR? 3 IR’; r( 
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x 
42. 7: IR? —, 1R?. r y| = 2r—j 
J 3x+2zj) 
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3.4) 
i 2 
47. Let T: IR’ — IR? be a linear transformation. Let A=|2 3] be the matrix representation of the linear 
43. - 1R3 : . * 
Let T: IR? —, jp? be a linear transformation defined by T = (: d } ~_ 
, 7 x¥-r transformation 7 with respect to the ordered ae vectors v, = [1, 2)’. 
Find the matrix representation of T with respect to the ordered basis 


v, = (3. 4)’ in IR? and 
w, =E-1, 1. 1)’, w.=[1,-1, 1) w, = (1, 1, -1}' in IR>*. Then, (@eerniie die tnear renstornation T. 


Let T: IR’ —> IR? be a linear transformation. Let A = \ 2 I 


—_ s| be the matrix representation of 
the linear transformation with respect to the ordered basis vectors v, = [l, -1. 1 


{E(w er CG) oe . 


44. Let F and HW be two vector spaces in IR?. Let 7: Vi ™ be a linear transformation defined by 


. 0 
F =| x+y |. 
(Zz e+ y¥+z, 
Find the matrix representation of T with respect to the ordered basis | 
1} fo) fo I\ (1) fo 
= OL/1,/0}7 in ¥ and y= qOLJ1L}1]) ine 
0}; (0) \! 1} \O0) 1 
45 


= atz 
Thy = x+yl. 
x x+yr+z 


Find the matrix representation of T with respect to the ordered basis 


r v, = (2, 3. -17". 
={l,1 -1}' in IR? and w, = (1. 1)’. w, = (2, 3)’ in IR*. Then, determine the linear transformation T 


I 2 
49. Let T: Py(f) 4 Pd) be a linear transformation 1+ A + | 


2 3) be the matrix representation of the 
14 


linear transformation with respect io the orcsred basis (1 + 1, 1] in P,(r) and [1 — t, 2s. 2 = 3r - rj 
in P(r). Then, determine the linear transformation T. 


Let V be the set of all vectors of the form (x), x2, x;) in IR> satisfying (i) x, — 3x, + 2x, = 0: 
(ii) 3x, — 2x, + x, = 0 and 4x, + 5x, = 0. Find the dimension and basis for V 


3.4 Solution of General linear System of Equations 


In section 3.2.5, we have discussed the matrix method and the Cramer's rule for solving a system 
of n equations in 7 unknowns, Ax = b. We assumed that the coefficient matrix A is non-singular, that 
is |A] # 0, or the rank of the matrix A is nm. The matrix method requires evaluation of n- determinants 
each of order (n — 1), to generate the cofactor matrix, and one determinant of order n, whereas the 
Cramer's rule requires evaluation of (n + 1) determinants each of order n. Since the evaluation of 
high order determinants is very time consuming, these methods are not used for large values of n, 


say n > 4. In this section, we discuss a method for solving a general system of m equations in n 
| unknowns, given by 

{-1 ne 1) (-1) (-1 Ax=b 
x= 4) IL/-Ih] Up im V and y= 4)-1),/ IL]-1]} inw 

Bee 






(3.28) 
-I} (-1) | 1) Q, 42 --- Aly By x 
where Aw | 72! [2 ee ad eee 
he x+y : 
46. Let 7 IR’ — IR* be a linear transformation defined by T yl= ae Fmt Fm == Fn On *n 
+z 
4 = ; =. 
X+ytz 


are respectively called the coefficient matrix, right hand side column vector and the solution vector 
Find the matrix representation of T with respect to the ordered basis 


The order of the matrices A, b, x are respectively m x mn, m x | and n x 1 


' The matrix 
1\ (1 fo | OV f1) f1 1}) a, 4) --- a | 4 
oie bd da 2 0 Sacer Teed is OL LET in ar! 
iisttil lo : 


(A\b)= “a Gy «+» Aby 2 


(3.29) 


te he +> Ge | Ge 
ee 
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1s ee 
ies in a” “ssn WIGLFEX and has wn rows and (7 + 1) columns. The augmented matrj 
pletely the system of equations. The solution vector of the system of equations 3 settles 
° ) 15 a 
n 


n-tuple (x), x, ..., x,) that satisfies all the equations. There are three possibilities: 


(i) the system has a unique solution, 
(i) the system has no solution, 
(iii) the system has infinite number of solutions. 


The 5 fem i 7 7 - = 7 

wea aaa equations is said to be consistent, if it has atleast one solution and incons; 

Se a pt Using the concepts of ranks and vector spaces, we now obtain the me if it 
nditions for the existence and uniqueness of the solution of the linear — and 


equations, 
3.4.1 Existence and Uniqueness of ‘the Solution 
L . i a + 
et VY, be a vector space consisting of -tuples in IR"(or C"). The row vectors &,, R R 
I» Roy vos Ry OF the 


: - 1 2 1 ® . i i I ; 


and is denoted by rr(A). Therefore, 


row-rank of A = rr(A) = dim (5). G 

zs. | 30 

me we define the co/umn-space of A and the column-rank of A denoted by er({A) 
_ = padi of m x 1 matrix A is generated by m row vectors of A, we have di . 

since S is a subspace of VY, we have dim (S) Ss n. Therefore, we have ; 7 rage x 

re(A)S min (#t,) and = similarly er(A) = min (m, 7). (3.31) 


Theo 6] = i 
2 rem 3.6 Let A = (a,,) be an.m x # matrix. Then the row-rank and column-rank of A are same 
ow, we stat | ich j | 
| € an important result which is known as the fundamental theorem of linear algebra 
Theorem 3.7 The non-homo 1 +. 
siecle geneous system of equations Ax = b. . I ix, has 
=o. : ae! x where A Is 
ution if and only if the matrix A and the augmented matrix (A | b) ie barn na 


In section 3.2.3, we : 

ped Waar abet, bs hep the rank of m x m matrix A in terms of the determinants of the 
is nonsingulc wee at n ees has rank r if it has at least one square submatrix of order r which 
lisse comsamiee sahias ei : oo of order greater than 7 are singular. This approach ts very 
winaiie: rge. Now, we discuss an alternative procedure to obtain the rank of.a 


3.4.2 Elementary Row Column Operati 
4 €. ow and Column Operation 
The following three operati i 
£ operations on a4 matrix A are called the elementary row operation 
é rons: 


bi Interchange of any two rows (written as R, ~ R,) 
Me ee of any row by a ra scalar (wri 
ing/subtracti ' written as ak, 
that ne mucke eee multiple of any row to another row ( ae R, — R, + aR, 
of the ith row. The ise ty ne of the jth row are added to the conreapondin elements 
ith row “ of the jth row remain unchar | ~ 
get changed). anged, whereas, the elements of the 





e Problems 3.43 


Matrices and Figenvalu 
hey do not change 
‘fF the matrix B 


e the row-rank of A ast 
perations. Then, 


do not chang ; 
Jeni to a matrix A, 


aid to be row equiva 
f elementary row ° 


s change the form of A but 
ence Oo 


se operation . | 
a the row-space of A. A matrix Bis 5 
can be obtained from the matrix A by a finite sequ 

we usually write B = A. We observe that 


valent to itself. 


) every matrix is row equi 
equivalent to A. | 
uivalent to C- 


(i 
(ii) if A ‘s row equivalent to B, then B is row , : 7 
ow equivalent to B and B is row equivalent to C, then A is row ¢q 
of row) are called elementary 


(iii) if A is F 
The above operations is column in place 
column operations. 


3.4.3 Echelon Form of a Matrix 
Anmxn7 matrix is called a row ec 
preceeding the first non-zero entry of a row incr 
(or no other elimination is possible) is obtained. 
following are satisfied. 
(i) If the ith row contains all zeros, 
(ii) If a column contains a non-zero entry of any row, 
is zero, that is, if the ith and (i + 1)th rows are bo 


entry of the (i + 1)th row appears in a later colu 
nly after all non-zero rows. 


performed on columns (that 


helon matrix or 1" row echelon form if the number of Zeros 
eases row by row until a row having all zero entries 
Therefore, a matrix is in row echelon form if the 


it is true for all subsequent rows. 
then every subsequent entry in this column 
th non-zero rows, then the initial non-zero 


mn than that of the ith row. 


(iii) Rows containing all zeros occur 0 


For example, the following matrices are in row echelon form. 


l 
1 -l 2 3 
0 
¢ OO S55 
0 
0 0 0 0 
0 


Oo — 


Le ye 
oO 5 4 
0 0 O 


. 


‘e 
* Let A = (a,) 
with some other row to m 


operations, we reduce the matrix A to 
made zero, then elements in the second column below a 


Similarly, we define the column echelon form of a matrix. 
Rank of A The number of non-zero rows in the row echelon form of a matrix A gives the rank of 
the matrix A (that is, the dimension of the row-space of the matrix A) and the set of the non-zero 


rows in the row echelon form gives the basis of the row-space. 


be a given m x n matrix. Assume that a,, # 0. If a,, = 0, we interchange the first row 
ake the element in the (1, 1) position as non-zero. Using elementary row 
its row echelon form (elements of first column below a), are 
are made zero and so on). 


Similar results hold for column echelon matrices. 


Remark 13 
bes and the 


(i) If A is a square matrix, then the row-echelon form is an upper triangular 
column echelon form is a lower triangular matrix. 
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il . : a 
(ii) This approach can be used to examine whether a given set of vectors are linear] 
ci = re , cr I 
or not. We form the matrix with each vector as its row (or column) and reduce 'ndependens 


(column) echelon form. The given vectors are linearly independent, jf the row It tO the row 
has no row with all its elements as zeros, The number of nOn-Zero rows is the i form 
the given set of vectors and the set of vectors consisting of the NON-Zero rows 'MEnsion of 
: 515 the 
Example 3.25 Reduce the following matrices to row echelon form and find their ra basis 
NKs. 
1-3 5 [i a2as 
OF} 2 at al, apt) +2 
l2> 8 2 |S 2 F 
6 | 14 17 
Solution Let the given matrix be denoted by A. We have 
1 2a | 
ee ae : Ry -2R, Ps § l oe 
Ryton, > 0 -7 -6 f,+2R, 8/16 ~7 6. 
-2 82 0 14 12 OOMAy y 


This is the row echelon form of A. Si 
: - Since the uf , 
farm i62, we ih rai CA m number of non-zero roWs In the row echelon 





12 2 4 
: 21 4 5 |R2-2R, 1 2 3 a i..2. 3 «# 
a LS 4 7 / tere ey ee eee, U8) Sa <3 
| %. 4 ot of | 
8 1 14 17/%s~8R, : 2 3/R®s-5R, “]0 0 0 0 


-15 -10 ~15 66 0 4 


Since th 
€ number of non-zero rows in the echelon form of A is 2, we get rank (A) = 2. 


Example 3,26 Red 
uce the following matrices to column echelon form and find their ranks 


a 2 
4 -] 7I (ii) —I | 3 —> ‘ 
ee ee ae 

Lt @ 


i W 
* Fil € 


i a 
1. 2 4/¢ pa Se 3 
(i) A= ey a- C73 Ty 5/3, 5/3 0 0 
— 7 “ Et j | I 
oe G-7C,/3 14 -7/3 7/3 Cy)-C, = p ee 0 
| =i se © 
’ ae ua 2 I/3 0 


ee : 
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| Since the column echelon form of A has two non-zero columns, rank (A) = 2. 


g te mel rt 0 OO oI i eas 
C5-C 
—| jot ms | 2 —-4 -2/C,+2C, ” -l 20 0 
iA ky ge tT B Gs Te i -1 2 4) €,+€, 1 -1 0 oO; 
i - 2 32 al 1-2 4 2 Ls 64 


Since the column echelon form of A has 2 non-zero columns, rank (A) = 2. 


Example 3.27. Examine whether the following set of vectors is linearly independent. Find the 
dimension and the basis of the given set of vectors. 

(i) C1, 2, 3, 4), (2, 0, 1, — 2), G, 2, 4, 2), 

iy Ci, 1,0, 1,1, 1.1) G1, 1. 1.4), G,0,.0, 1), 


(iii) (2, 3, 6, —3, 4), (4, 2, 12, —3, 6), (4, 10, 12, —9, 10). 


Solution Let each given vector represent a row of a matrix A. We reduce A to row echelon form. 
If all the rows of the echelon form have some non-zero elements, then the given set of vectors are 


linearly independent. 


iso « "fb... za i Bg 4 
; R,—2R, 
S28 Be’ 16-4 6.10 i +. 2-0 


Since all the rows in the row echelon form of A are not non-zero, the given set of vectors 
are linearly dependent. Since the number of non-zero rows is 2, the dimension of the given 
set of vectors is 2. The basis can be taken as the set of vectors {(1 2 3 4), 


(O, 4) 25, <103%. 
1101 t me 0 
(i alter ® tee ae fig 
ii) A=| Pia ek es Le: ) 
(ii) = Be ae 6 2 7 alter Ale- os of tet ee 
i 6 O eh lptteae 6 G .F O-6 
a oe a a 
O-2 4 3 0.27 & 2 
m R,—R,/2 = | 
rer ee Ft Pe 
0D 1 at fe 


Since all the rows in the row echelon form of A are non-zero, the given set of vectors-are 
linearly independent and the dimension of the given set of vectors is 4. The set of vectors 
{(1, 1, 0, 1), (0, 2, 1, 2), (0, O. 1, 0), (Q, 0, 0, 1)) oF the given set itself forms the 


basis. 
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(iii) A=|4 2 49 Brg R, —2R, ‘ 
4°10 12 9 i R,-2R, =/0 -4 0 3 -2 Ry +R, ~ , 3 6 “3, (a) Let 7 < m and one or more of the elements b..). 6 ,..2, .... hb. are not zero. 
Since all th Y £6 -3 2 0 “tO” “9 Then, rank (A) # rank (A | b) and the system of equations has no solution. 
linearly d a Ws tn the echelon form of A are not non-zer "= @ 4] (b) Let m 2 mand r= n (the number of columns in A) and b, 1. D, -2. «--+ by are all zeros. 
of eas ; ent. Since the number of non-zero rows is 2 f a Siven set of vect | In this case, rank (A) ¥ rank (A | b) = 1 and the system of equations has a unique solution. 
! > < and its basis can be taken as the set {(2, 3 + ine dimension of the “OTS are We solve the nth equation for x,,, the (m — |)th equation for x,_, and so on. This procedure 
3.4.4 Gauss Fj > 3, 6, -3, 4), (0,~4 9 -_ Set is called the back substitution method. 
ae S Elimination Meth . re Uy 5, =I , a? oe 
Consider a non-ho od for Non-homogeneous Systems Me : For example, if we have 10 equations in 5 variables, then the augmented matrix is of 
mogeneous system of m equations in n unknowns order 10 x 6. When rank (A) = rank (A | b) = 5, the system has a unique solution. 
seins (c) Letr<n and b..,, b,.>. ---, 6, are all zeros. In this case, r unknowns, x;, X>, -.., x, can be 
| determined in terms of the remaining (n - r) unknowns x,.;, x... ---, x, by solving the rth 
Qi Wa. xa: a | : (3.32) equation for x,, (r — 1th equation for x,_, and so on. In this case, we obtain an 
a - Oty 5, x, (n — r) parameter family of solutions, that is infinitely many solutions. 
néere A wig a>; 45> ae a>, b 
: ,b=!| 7 ll x4 | Remark 14 
Bn Ano ” | . (a) We do not, normally use column elementary operations in solving the linear system of 
«i = ie Day x, equations. When we interchange two columns, the order of the unknowns in the given system 
ana ies that at least one element of b is not zero. We write th of equations is also changed. Keeping track of the order of unknowns is quite difficult. 
+ 1) as € augmented matrix of order (b) Gauss elimination method may be written as 
Elementary . 
Q5) Giz «es App by (A | b) > (B ‘c). 
: ; row operations 
(A[b)=| 2! 92 M20} . . 
: The matrix B is the row echelon form of the matrix A and ¢ is the new right hand side column 
eg Baw ass, a 1d vector. We obtain the solution vector (if it exists) using the back substitution method. 
and : leith (c) If A is a square matrix of order n, then B is an upper triangular matrix of order n. 
reduce — : 7 9) eo ) Z “A 
es It to the row echelon form by using elementary row operations. We need a maximum of (d) Gauss elimination method can be used to solve p systems of the form AX = b,, Ax = by, ..-, 
stages of eliminations to reduce the give evan | i: Ax =b. which have the same coefficient matrix but different ngnt hand side column vectors. 
form. This given augmented matrix to the equivalent row echelon P ; . 
‘ Process May terminate at an earlier stage. We then have a ival f the fi ! We form the augmented matrix as (A | b,, bp, ---- b.), which has m rows and (7 + p) columns. 
n equivalent system Of the form Using the elementary row operations, we obtain the row equivalent systern (Bj ¢;, 
| -«+y €,), where B is the row echelon form of A. Now, we solve the systems Bx = ¢;, 
ay) Gyo ee ay, - Ay b, : Bx = .., BX = Ci. using the back substitution method. 
° d55 rr a, ne Ay hb, | Remark 15 
(A 2 : | (a) If at any stage of elimination, the pivot clement becomes Zer0, then we nips this row 
TO 0 Oe ay Om | & (3.33) with any other row below it such that we obtain a non-zero pivot clement. We normally 
e F QQ . 0 Bis | choose the row such that the pivot element becomes largest in ee asi 
‘ ” | » Tec HITLt _ ft is possible fo compa? 
Hy) nn x nsysiem, we require (n - 1) stages of ecliminabon. 1 15 pow” : 
(b) For ann x 7” Sy tions, multiplications and divisions. This number is called 


pons, subtrac 
the Gauss elimination method for 


total number of addi 
count is approximately 


f) 0 ore 0) ene 0 b,, 
! the operation count of 
solving ann xn system 15 nn 


where r Sum and 7. ‘ ! 
45, #9, az, #9,..., 4, #0 are called pivots. We have the following cases: | n'/3. 


the method. The operation count of 
2 Fn $3, For large 4. the operation 











2-48 Engineering Mathematics 


Example 3.28 Solve the following systems of equations (it possthic 


sie } Using Crdus« chimp 
Wie, 

> £ =iffs 4 2 O Dfx] fy 

Lp) =F ce —2 |, (i) J) =t Itty | 
-l 2 -}]}- ? 2 =2 3) l= {3} 
1 -] Tx l 

Ur) fe aan Me yl =]2 
5-2 2I|- 5 


Solution We write the augmented matrix and reduce it to ro 


w echelon form by 
TOW Operations. ie 


ae i ee i 
G@Alb=| 1-1 2f-2) 2? “elo — | , 
Re+R i219 ~3/2  5/2|~4) Ry + srg 

“1 2-3 2 O° 5/2 —aal 


2 I —| 4 
=/0 =-3/2 5/2] ~4|, 
0 0 8/3|-8/3 


Using the back substitution method, we obtain the solution as 
8 8 
37; F or z7z=— I, 
: Fn 5 
=57 "5" S48; Or yo j, 


2x+y-z=4, or x=] 


Therefore, the system of equations has the unique solution x = 1, y=1,z=-1. 
” a O. Jan }2 O ] 3 
(ii) (Ajb)=|1 -1 a ee Be 
| {4 -2 3/3} % ~) 


(A) =: and rank (A | b) = 3. Therefore, the system of equations has no 


z 0 1 3 
| 1 1/2|}-1/2| R,;-2R,=|Q0 -1 1/2)-1/2}. 
D ses Zin Mio 3 6.0.01) =z 


eo aha 


Et 
ta 
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The system is consistent and has infinite number of solutions. We find that the last equation 
is satisfied for all values of x, y, z. From the second equation, we get 3y - 32 = 0, or » = =. 
From the first equation, we getxr-y*+ z= 1, or ¢ = |. Therefore, we obtain the solution 
x= 1, y = z and z is arbitrary. 


Example 3.29 Solve the following system of equations using Gauss elimination method. 
(i) 4x - 3y —- 9z+6w =0 (ii) x + 2y-2 =1 
dx + Jy + 32 + 6w 


6 2x -3y+2z=0 
4x —2ly —39z -— 6w = -24, Sx +y-—5z =] 


3x + l4y - 122 = 5. 


II 


il 


Solution We have 


= 


=3 = 6] 06). [4-3 -9 6] Oo 


| 1R,-R,/2 
(i) (A| by =] 2 3 3 6 6 bie =|0 9/2 15/2 3 6) R, +4R, 


-21 -39 -6|-24 0 -18 -30 -12\-2 


BE 


fei 


-3 =-9 6/0 
9/2 15/2 3} 6). 
0 0 0|0 


I 
o oO 


The system of equations is consistent and has infinite number of solutions. Choose w as 
arbitrary. From the second equation, we obtain 


From the first equation, we obtain 

4x = 3y + 9z — 6w = 4 — 5z -— 2w + 92 — Gw = 4+ dz - Bw 
or x=1+2z—~ 2w. 
Thus, we obtain a two parameter family of solutions 


x=1+2z-2w and y= (4 - 5:- 2wy3 
where z and w are arbitrary. 


1 2 -2 Fae oe t' 2 “9F 4 

(ii) (A |b) = zs WO ute _|9 -7 3) -2]R8)-98,/7 
S$ 4 sSiy? (* jo -> $141k, 48/7 
¥ a tsi" te 2 ue) 2 
1 2 --2 | t 2 =2 
0 -7 eee 10 -7 | ae 

“19 0 -10/7| -10/7 ik sales 0 0 -10/7) -10/7/ 

0 O -2/7| -2/7 0 0 0 0 
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The last equation is satisfied for all values of x, y, z- From the third equation, We obtaj 
Back substitution gives y = 1, x = 1. Hence, the system of equation has a unique schiis. “mg 
y= 1 and z= 1. Since R, = (24R, — 7R, + R,WVS5, the last equation is redundant, __ N=] 


3.4.5 Gauss-Jordan Method 


In this method, we perform elementary row transformations on the augmented matrix [A | b), wh 
iS a Square matrix, and reduce it to the form ve 


[Alb] Se le] 

Where I is the identity matrix and c is the solution vector. This reduction is equivalent to findi 
the solution as x = A™' b. The first step is same as in the Gauss elimination method. From second a 
onwards, we make elements below and above the pivot as zeros, using elementary row trans Lenaigt 
Finally, we divide each row by its pivot to obtain the form [I | c]. Alternately, at every step, the pane 
can be made as | before elimination, Then, c is the solution vector. 

This method is more expensive (larger operation count) than the Gauss elimination. Hence, we do 
not normally use the Gauss-Jordan method form finding the solution of a system. However, this method 
is very useful for finding the inverse (A~') of a matrix A. We consider the augmented matrix [Al T] and 
reduce it to the form 


[A] 5 (11 A7] 





using Bementny row transformations. If we are solving the system of equations (3.28), then we have 
x= A b, and the matrix multiplication in the right hand side gives the solution vector. 


Remark 16 
If any pivot element at any stage of elimination becomes zero, then we interchange rows as in the Gauss 
elimination method. 


Example 3.30 Using the Gauss-Jordan method, solve the system of equation A x = b, where 


i -] |] 0 
A=/2 1 -3!/, and h=/|4 
l I l l 


Solution We perform element van 
form {11 C]. We pet entary row transformations on the augmented matrix and reduce it the 


lL sx] 2 16 J] =] j 

$ i 0 
[Alb]J=/2  ] -3}4 | aoe 3 ~§l4] RR, /3 
Fgh eT 0 2 on] 
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| 2a i | fo 2273| 4/3 
| | eae 3 10/3 
=(0 4-5/4) 4/35) 4g =o TF ~5/3| 4/3] R;/(10/3) 
| 0 2 o| -if? oO * to 0 BORST-SkS 
—~2/3| 4/3 t o' 6 1 
re | R, +2R,/3 
=/0 1 —5/3| 4/3 | =/0 1 O| 1/2). 
» | Ry +5R,/3 | 
0 0 1] —1/2 0 0 1|-1/2 
Hence, the solution vector is 
x=[1 2 -1/2]". 
—1 12 
Example 3.31 Using Gauss-Jordan method, find the inverse of the matix A=] 3 —I 1 
—1 3.4 
Solution We have 
— £2[1 09 
(A| =| 3 -1 1/0 1 Of. 
=| 34/0 D 1 
The pivot element a,, is —1. We make it 1 by multiplying the first row by —1. Therefore, 
1 -1 -2]-1 0 0 1 =-1 -2/-1 0 0 
(A|D=] 3-1 1 2A DB oe =o 2 71 32 1 O} RR 
at 4 Cire e ae ott. 2-2/8 1 
Ni ie: ek 1 0 3/2/1/2 1/2 0 
=!0 1 7/2/3/2 1/2 Oo} on =10 1 7/2})3/2 1/2 O| (-R;)/5 
Oo 2. g-1 ear * (6.6 -s[-4 -—1 7 
it gn Ww OT Salis 1 0 Oo] —7/10 2/10 3/10) 
wi 1. W2,3l2 3A." 0} sea" 0 1 O}-—13/10 —2/10 7/10}. 
90 11475 16 -15)" "" Te-o I 4/5 W/5 -1/5 
7 =f. 2° 3 
Hence, A oe) -13 —2 7 ie 
: :. 2 2 
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3.4, , 
6 Homogeneous System of Line 


Peat ar Equati 
Consider the homogeneous oe 


system of equations 


Ax=9 
Where A ig anom x 
: A matrix, 

solution) ig always a fests =f The homogenous system is always CONsiSstent sj (3.34) 

System to have a non-triy; . n this case, rank (A) = rank (A | 0). Therefo since x = (trivio 

a0 (9 ~ r) parameter mile ree we require that rank (A) < y. If nbs ~ homogenecng 

Of solutio j 3 ; ss 

Parameters can be chosen arbitrarily, one which form a vector space of dimension tr : “ ee 

~ 7) a8 (n : 


The Solution “nace 
Space of the homo P 
( Beneous system i: 
he nullity of A. Therefore, we obtain the result aes 


rank (A) + nullity (A) = 7 (sce Theorem SS), 


Space and jts dimension IS calleg 


Remark 17 


(a) If x, and x . 
! Xz 4T€ two solutions of a linear hom 
a: ) 7 lOogeneous syst | 
_ of the homogenous system for any scal ys em, then ox 
on-homogenous systems. % P. This result q 


(b) A homog wns 
: €neous system of m equati 
no 1Ons in 
non-trivial solution. = ee EE - 


Tl Bx, 18 also a 
C&S not hold for 


always possesses a 


solutions are of the fj 
| OrmM xr = X9 +x, whe - 
! en h re Xo IS any fixed i AY ; 
of the corr esponding homogencous system. c Solution of Ax = b and X, 1S any solution 


Proof Let x be any solution and x, be any fixed solution of Ax = b. Therefore, we have 
Subtracting, we get Ax=b and Ax, =b. 

Thus, the difference x — x - ~ AXxy = 0, or A(x — x) = 0. 

Ax = b is a solution of the Lema 7 of Ax = b and any fixed solution Xp, of 
Remark 18 ysiem Ax = 0, say x,. Hence, the result, 

If the non-homogencous system Ax = b where A is an m x n matrix (m 2 n) has a unique solution, 


that is x, = 0, responding homogeneous system Ax = 0 has only the trivial solution, 


Example 3.32 i 
ple 3.32 Solve the following homogeneous system of equation Ax = 0, where A is given by 


AI 3 ac 2 
: | ~3 i. ft =i" F 
yb =F, CV 8 Rs Gees g (iii)}/2 3 1 4] 
2 Yond 1 3.2 =6 QJ 


Find the rank (A) and nullity (A), 


yy 
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solution We write the augmented matrix (A | 0) and reduce it to row echelon form. 


2 LV 0 2 1] 0 2 1; 0 
(i) (AJO)=]1 -1/0 =/0 —3/2|0) R3+R/3 =|0 -—3/2]0). 
R, —3R,/2 ; | 
3 2/0 0) 1/2) 0 0 0; 0 


Since, rank (A) = 2 = number of unknowns, the system has only a trivial solution. 


Hence, nullity (A) = 0. 


1 2-3/0], _, fi 2 -3{o I 2 -3/0 
(i) (A|0)=]1 1 -1/0 ais =|0 -1 2)0|R,-3R, =|0 -1  2Iol. 
1 -! 10} * " Jo -3 40 0 0 -2{0 


Since rank (A) = 3 = number of unknowns, the homogeneous system has only a trivial 
solution. Therefore, nullity (A) = 0. 


1 t =—1 1/0 : a 1'o rt =—f 176 
esis R, — 2K, ; 
(iii) (AJ O)=|]2 3 l 4/0). x 0 I 3 2)/0\/R;+R =|0 1 3 2/0 
426 pore ; OQ =f =3 S30 00 O OO 


Therefore, rank (A) = 2 and the number of unknowns is 4. Hence, we obtain a two parameter 
family of solutions as x, = —3x, —2r4, x, =— x, + x; — x, = 4x, + xy, where x, and x, are 


arbitrary. Therefore, nullity (A) = 2. 


Exercise 3.3 
Using the elementary row operations, determine the ranks of the following matrices. 


20 -1 Y wu or 2 
ae ae Me 212 #41 2b e les ae 
we, ee 5-5 1 | t= 
l 

12 -! 1 Eo J sy ; : : 

4. [2 3 4 5 5. | 1 1-2 3h. 6. oa : 
~ = 4 1 -5 8 "8 

1 4 -13 -5 Sse Se 

| Zi & List 1 20 -1 0 

-l lt = 4 i @ 3 
7 es ae 5} 3. 'y ‘ | 
ult 4 38 EQ. 2 or 36 
9 15 21 27 babe 6 1 -2 6 





al 


C 
cy 





COP ats VMeithauncstye . 


i 
“— 
— 


al 
P= J 


-_ 
oe 
Psd 
ft 


* £€ 3 ay 5 


Using the e 
NE (he elementary voli 
¥ column oper: reat 
Pp ACMOTYS | delermine the rank of the rerf bevy MS Erte oe 


! = 
) ’ ea | cE oh fe | =] x 
3 | —1 q at | q sf LS ‘ 
| 2 —3 2 | (} 4] 
2 , .. = 
14. | eop Pap 
— 4 = 
bE 4 2 mal & SS 3 
5 4 ~§ iS oe ap ol 


Detennine w | P 
hether the following set of vectors is linearly independent. Find dis0 ts dimension 


16; ((3..2. 4). (4,6): 2)(s =, ee 


é 


vs WS Bo Pa. . mn a Bo 


BS. (20, 0)... =F) Spa, ays 19. 42 | 


ei, 1 
20, (hb. 1, D3. 1h OE ee 


led 
ro 


Cr ~f, iy} 
2by (dy RAMEE Ik, 1), (1,8) BG Te OSE, 


22. (01, 223.9), (26 Teoh Bote B35). (3. 4. 1, 34, 


rT 


23. {(t. 2. 3, 4), HL) (14, ERE B. 14) 
at iG, 1.0, 4.01; hb Ne (4. 4.1). 1, 0, 0. 1). 
45. {(2, 2, 0. 2), (4, 1. 4, 1). (3, 0. 4, Oy). 


Determine which of the following systems are consistent and find all the solutions for the consistent system 


2-3 «ffir = | 


2 [ 4 7ifx | 1-4 Flix 8 
26. [I -!l 2i[/¥J}=] 3}. 27.12 5 Silyl{=f2]. 28. (3 8 -2]//r/=[6]. 
2 1 -3){z] |-2 12 ate] 1 7 -8 26/{z} |3 
Ey dais 3 1 | Ullx 7 2 ® =3ITs 0 
29. |3 -9 2} /y}/=]-4}. 30. {1 2 3/lvj=! 16]. 3.1/0 2 -3 |. 
13 4}fz] j22) fr -1 afte] [a 
a ha ' tora aed [4] 
Ni y=f2to aa dy on a , “bt 
a s| Eid afl") fe 
w : a 
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Find all the solutions of the following homogeneous systems Ax = 0, where A is given as the following. 


ao = ian Ean 4 =]1 5 
$6 (1 =e BF <a eae ee a 38. |4 1 -10 
1 4 «4 -l +7 il 4 9 -6 
123 4 ie Pee. ee ae 
* Tr) tt ft 40. ; : ‘acasplt 41. ~ j 4 
126 RB — = 
-l 5 9 1 2 ae oe | 
D4 0 | i f= @ (=> W =f 
04 10 1 ee ee ees Ll a7 3 
42. . ; 44, , 
io 273 mis oe os 4 4 1-5 8 
to 4 3| oe ey ee 3 Bay 
Lop Se *S 
2 — | 
45. ee: | 
3.2 29 2g 
42 2 -4 


Using the Gauss-Jordan method, find the inverses of the following matrices. 


ar 
a ae 23 1 eo 
46. {1 2 31. 47. }1 3 31. ica (es ae a 
134 9.1 2 3 
PA" yxy 
fof = 4 r i686 
af 7 “ =| ee ¢ 7 J 
50. | 
ME A cpr 92% 44-44 
a oe a 1001 


3.5 Eigenvalue Problems 

Let A = (a,) be a square matrix of order n. The matrix A may be singular or non-singular. Consider 
the homogeneous system of equations 

Ax=Ax or (A-AI)x=0 (3.35) 
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Where J is 4 scalar and I js a 
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| N identity matrix of orde The ‘u - : 
oO always has a trivial solution. We need to find ale ae es woe wenn Ge Cyuat; set of the eigenvalues is called the spectrum of A and the largest eigenvalue in magnitude is 
-35) has non-trivial solutions. The values of 2 for whi : SOF which the homogeneous ce Ong bie 4 dis suectral Féclliis OF A aad 16 demeacd by p (A). If [Al = 0, that is the martix is singular, then 
eta 33>) Exist, are called the eigenvalues or the ch 4 ae ye Sauions OF the homogene os Eq ( 3.38), we find that atleast one of the eigenvalues must be zero. Conversely, if one of the 
non-tnivial solution vectors x are called the sleet tow: - pd oo ete comrespong; enw tiel is seit, then |Aj = 0. Note that if A is a diagonal or an upper triangular or a lower 
# non-trivial solution of the homoow = CUAEACIORISNG Véciors of ng S - 3 the eigenvalues of A. 
, mogeneous system (3.35), ther h A. If y ; triangular matrix, then the diagonal elements of the matrix A are gen 
4 solution of the hom | + ten @ X, where @ is any co _ 8 : | 
. : | air ¢ eigenvalues and the correspond ultiple j=], 2, ..., 7 to obtain the corresponding eigenvectors. 
A is called an eigenvaly ponding eigenvectors of a *. Ric 3 pee sees sponding ¢1g 
es problem. square Matrix 
2 ‘ rties of eigenvalues and eigenvectors 
35.1 Eigenvalues and Eigenvectors Prope S = the followi 
If th | A be an eigenvalue of A and x be its corresponding eigenvector. Then, we have ollowing 
‘ homogeneous System (3.35) has a non-trivial solution then the rank of : — 
(A — AI) is less than 7. that ic | : :; OF the coefficient mar: results. 
fi, tis the coefficient matnx must be singular. Therefo Matrix , 
“ 1. @ A has eigenvalue @A and the correspord*=c eigenvector is x. 
a4,,-A a, a, Ax = Ax => @ Ax = (@A)x. 
| a>, Gy,—-A --- g 2. A® has eigenvalue A” and the corresponding eigenvector is x for amy positive interger mm. 
det (A — AI) = : In ay ee ; , 3 
: whi ‘ (3.36) Pre-multiplying both sides of Ax = Ax by A, we get 
| Bay an» ae | AAx = AAx = AAx = A(Ax) or Au = 2x. 
7 nr 
: Therefore, A* has the eigenvalue J? and the cofresponding eigenvector is x. Pre-multiplying 
Ex * = # , . . 
panding the determinant given in Eq. (3.36), we obtain a polynomial of degree n in J, which is successively m times, we obtain the result. 


of the form : . . 
3. A —&kI has the eigenvalue A — k, for any scalar & and the corresponding ¢igenvector is x. 


Ax=Ax=>Ax-kix=Ax-—kx 
or (A - kI) x= (A = &)x. 
4. Av'(if it exists) has the eigenvalue 1/A and the corresponding cigenvector is x. 
Pre-multiplying both sides of Ax = Ax by Av', we get 
A‘Ax = AA's or A''x = (VA)x. 
5. (A — kI)"' has the eigenvalue |/(A — k) and the corresponding eigenvector is x for any 
scalar k. 
6, A and A’ have the same eigenvalues (since a determimant can be expanded by rows or by 
columns) but different eigenvectors, (see Example 3.41), 
7. For a real matrix A, if @ + iB is an eigenvalue, then its conjugate a — i is also an eigenvalue 
(since the characteristic equation has real coefficients). When the matrix A is complex, this 
property does not hold. 


PAA) =|A- AI] = (-1)" [a” - Oy ae ee Ait (-1)"'¢.] =0.: 


or A” — oA? + ©, RP? — + (-1)"c, = 0. (3.37) 
were Cj» £2, -.-5 Cy oan be expressed in terms of the elements a, of the matrix A. This equation is 
ee the characteristic equation of the matrix A. The polynomial equation P(A) = 0 has vn roots 
. can be real or complex, simple or repeated. The roots A,, Az, ..., A, of the polynomial equation 
nA) = 0 are called the eigenvalues. By using the relation between the roots and the coefficients, 
we can write 
Ay tag t+ d= c= ay +n + 4a, 
Ayan + AAs +... +A, 4; n= Co 


A,A, ... A, = ze : (3.38) 
If we set A = 0 in Eq. (3.36), then we get 
|A| = (-1)""c, = c, = AA, ... Ay 


We now present an important result which gives the relationship of a matrix A and its characteristic 
€quation, 
Theorem 3.9 (Cayley-Hamilton theorem) Every square matrix A satisfies its own characteristic 
equation 





Therefore, we get 


sum of eigenvalues = trace (A }, and product of eigenvalues = |AI. 


AY oA +... + (1% eo At ec, EO (3.39) 


a 
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Proof = The cofactors of the eleme 


nts Of the deters; 
| H Pt achtyt . 
(— 1) or less. Therefore, the ele : ‘ 


phan] They 





ments of the adjoint ni: Maks jp 
also polynomials in A of deeree Poe hee i a a Wry eerueseacice of the Giiern Auf degre. 
polynomial in JL white SREB clei 3 fs B. eMee. We can cApPress. the idjisj T TVA x | dre 
l* : ue Sic * : an 
as fiinctions of the elements Sri Mose ae re SS matrices of order ” ‘ie Matrix: a. a 
wy WE Can write rane Clemeny, 
ad fl A - Al) = BA" eee K qu 2 
We also have = Pree TR GA 4 B.. 
(A-ATD aly (A-AI)=|A All I 
Therefore, we can write for any A 
(A — AI) (B,A""! + B.Al = +B A+R 
‘ nit a—[“> * Gy) 
=A <2 a4 4 7 +1)" a Al ‘ ( ” 
; _ nel poe | 
Comparing the coefficients of various POWers of A, we obta; 
ain 
= B, = I 
AB, rs B, = c,! 
AB, == B, = cl 
AB, { = B, = (— y" ~ | Ch | I 
AB, = (-1)" c,1 
Pre-multiplyi -quati n 
plying these equations by A”, A" ae | respectively and adding, we get 
A” — 2 A" ae ; i | 
ee ] eon + (-—1) tc A + — fl = 
which proves the theorem. - eee 
Remark 19 
(a) We can use Eg, (3 a ee ae ee 
9. (3.39) to find Aw! (if it exists) in terms of the powers of the matrix A. 
Pre-multiplying both sides in Eq. (3.39) by A-!. we get 
A A® c =I an! ; n-} i 
) AA PG se OP te) C,\A ‘A + (-1)"c, AU =A 'D=0 
or | ae ly 1)" a 
A as : [A" : ¢; Al?  # (ryie’ er (3.40) 


'b " 4 
(b) We can use Eq.(3.39) to obtain A” in terms of lower powers of A as 


A" = oar! ~! cA" “24 ws + (- ite, (3.41) 
Example 3,33 Verify Cayley-Hamilton theorem for th 


e martrix 
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(i) obtain A”’ and A°, (ii) find eigenvalues of A, A’ and verify that eigenvalues of A? are 
<quares of those of A, (ili) find the spectral radius of A. 


jution The characteristic equation of A is given by 


Sol 
1—A 2 0 
|A-AIj/=| -l 1-A 3 2/=(1-a) 401 - Ay? - 4) -2 [- (1-4) -2} 
2 TZ 
=(1- A) (A? - 22-3) 24-3) =-¥ +30 -A+3= 
| 12 oli 2 0] f-t #4 
Now, A7=/-1 1 2/|-1 1 2|=1 0 3 4 
ia iht24 06 5 
—j 4 4]] 1 2 Ol f-t 
Ate A"A@=| O 3 4]/-1 1 2]=] tO OW 10 
G 6 St 12 1 af. 15 7 
We have 
={ 10 1 sh ca 12 0 100 
-A>+3A°-A+31=-| 1 11 10/+3] 0 3 41-|-1 1 2}+3]/0 1 0 
~1 16 17 a Ss) LT 24 G09 1 
0 0 0 
=|0 0 O|=0. (3.42) 
00 0 
Hence, A satisfies the characteristic equation — A> + 347 -A+3=0. 
(1) From Eq. (3.42), we get 
-1 4 4 3 6 0) (1 0 0 = | 
At = 1 [a?-3a+I] => 0 3 4|-|-3 3 6l+lo 1 0 - =| 712 
3 0 65 3 6 3) lo o 1 af O 3 
From Eq. (3.42), we get 
= AZ 22 12 0] [3 0 Oo} f-1 10 12 
A5=3a7-A+3 =| O 9 12}-]-1 1 2}4+]0 3 Of=] 1 Il WW 
0 18 15 L-2) 2h 1D 8 3) cE 16 
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(ii) Eigenvalues of A are the roots of 
oak ae ee or (A= 3)(A* + 1)=0 or A=3,4,-; 

The characteristic equation of A? is given by as 

“I-A gg 

0 3-A 4 
6 


= (-1 — A) [G3 - A) (S - A) - 24] = 0 
0 S-A 


Or 


(A+ 1) (A° - 8A-9)=O0or(A+ I (A-9) (A+ 1) = 0, 


The eigenvalues of A? are 9, — 1, — 1 which are the squares of the eigenvalues of A 
(in) The spectral radius of A is given by : 


P (A) = largest eigenvalue in magnitude = max |A,| = 3 


Example 3.34 If A = 


- & © 
oOo =— © 


l 
| . then's al, iia -. 7 | f 
. how that A A™~ + A° —I forn > 3. Hence, find A» 


Solution The characteristic equation of A is given by 


or | ae 
|A-All= 1A Lj -Aa(H-D=0, o B-R-as 1-0, 
0 1-a 
Using Cayley-Hamilton theorem, we get 
A>-A?-A+1=0, or A? A?=A-L 
Pre-multiplying both sides successively by A, we obtain 
A’-A?’=A-] 
A‘- A} =A? A 


AD! ent Af®-- = A’? — At 
A" — An! fare A’ i A? 
Adding these equations, we get 


AN AZ —n At —~|l, or A” = A"-2 4 A? —-I, n2 3. 
Using this equation recursively, we get 
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li 


A" 


(A"4 + At -1) + A? —-1 = Att + 2(A7 - 1) 


i 


= Arta-2b 4 ; (n - 2) (A? - 1) = 


Substituting m = 50, we get 


A”? = 25A7 -241 = 25 


—_— = — 


0 0 0 0 0 OF; 

1 O|-24)0 1 O}=|25 1 O}. 

0 1 0 | 0 |] 
Example 3.35 Find the eigenvalues and the corresponding eigenvectors of the following matrices. 


0 0 
(ij A= : | (un) A= | i} (i) A = : 2 1}.- 
3 2 -I 1 2 9 3 


Solution 


(i) The characteristic equation of A is given by 


i «a 


|A-AI|= 3 »-a(7 or A>-34-10 =O, or A=-2,5. 





Corresponding to the eigenvalue A = -2, we have 


3 4\(x, 0 4 
A+2Dx-= " aa ee Sar a 
( ) (3 (2) 8 or 3x, + 4x, = 0 or x, =e 


Hence, the eigenvector x is given by 


x —4x,/3 ss 
r= [*]-| 2 |-= 4/3 
x2 x2 1} 
Since an eigenvector is unique upto a constant multiple, we can take the eigenvector as [- 4, 3] 
Corresponding to the eigenvalue A = 5, we have 


(A— 51) x= ¢ SE}-(0) or x, — x; = Q, or x, = x}. 
| 2 


Therefore, the eigenvalue is given by x = (x, x)" = x,(1. 1 or (1, 1Y 
(ii) The characteristic equation of A is given by 


1-A 1] 


IA ~ ati | ; al" o a°-24+2=0, of Aw12e 








ts, 
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Corresponding to the eigenvalue A = | i, we have 


[A-(1 +i) 1] x= ~~ May | [0 


—| aoa Ay () 
oF — ix; + x)= 0 and - xX; — ix, = 0, 


Both the equations reduce to 


7 = Sy — Ny =O, Choosing: &5.= 1,0e Bux), = | 
eigenvector is x = [—j, Weg 


= 


Uheretore 


» the 
Corresponding to the eigenvalue A = 1 — i, we have 
; iol x, | 0) 
[A -(1l -aI]x-= fs 
Or ix, + A — 0) and = ty r 1X5 = 0. 
Both the equations reduce to ~*); + ix, = 0. Choosing x, = 1, we get x | — +. Therefore, the Cigeny 
isx = [i, 1)’. 


Remark 20 


For a real matrix A, the eigenvalues and the corresponding eigenvectors can be complex, 


(111) The characteristic equation of A is given by 


Id O32 QQ 
IA-Alj=/| 0 2-4 1 
2 


= -or (l= A)(2 =a): 3' = 2)'= 0: ox A= 1,2. 3. 
O 3-A 


Corresponding to the eigenvalue A = 1, we have 


0 0 Off x, [}0 
(A-I)x=]0 5 Ill x, ]}0] or 
2 0 2]|/ x, {/0 


xX, +x,=0 


he. 


We obtain two equations in three unknowns. One of the variables x,, x5, x, can be chosen 
arbitrarily. Taking x, = 1, we obtain the eigenvector as [—1, -1, 1]. 


Corresponding to the eigenvalue A = 2, we have 


—| 0 0 | x; 0 
(A-21x=| 0 0 1||x,|=|0 
tg a | Poo Fie | x; | 0 


or x = 0, ¥3 = 0 and x, arbitrary. Taking x, = 1, we obtain the eigenvector as [0, 1, 0]’. 
Be oat, idle | : 


- *) he 8 Ti ; 
Pe et 
F a Se ; YP 
ele ian es 
a 
’ 
=i 
ry 


pe aos et 

scuualig wet bg tae 

Bhi te pyr Fee ee i ne 
tay 3 sgedite 6 [eee , 2 siee SS, 
oe oe ea ae ge LM he ig 
is at ha oe 


ik 
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Corresponding to the eigenvalue A = 3, we have 


~=2 0) 01 xj 10 7 
(a 
(A-31I)x=| 0 1 | 1x, |;O| or 4 eet 
2 0 Ijlx, }{0 


Choosing x3; = 1, we obtain the eigenvector as [ 0, -1, 1)’. 


Example 3.36 Find the eigenvalues and the corresponding eigenvectors of the following matrices. 
“ih 6 110 100 
ES (i) A= |0 0}, Gn) A=|0 1 O}. 
0 1 0 00 1 
Solution In each of the above problems, we obtain the characteristic equation as (1 — A)’ = 0. 
Therefore, the eigenvalues are A= 1, |, 1, a repeated value. Since a 3 x 3 matrix has 3 eigenvalues, 


it is important to know, whether the given matrix has 3 linearly independent eigenvectors, or it has 
lesser number of linearly independent eigenvectors. 


Corresponding to the eigenvalue A = 1, we obtain the following eigenvectors. 


010 0 At; = 0 
(i) (A-I)x=(0 0 1}x=l|0)| or x, =! 
00 0 0) x, arbitrary. 
Choosing x, = 1, we obtain the solution as [1, 0, 0)". 
Hence, A has only one independent eigenvector. 
ot Ole 0 
Te Xy = 
(ii) (A-I)x=|0 0 0 x,|=|0]|, or i 
X,,Xy arbitrary. 
0 0 O|}x,| Jo = 


Taking x, = 0, x, = | and x, = 1, x3 = 0, we obtain two linearly independent solutions 


x,= (0,0, 1)’, x, =[1, 0, o]7. 
In this case A has two linearly independent eigenvectors. 
0 O 0 ty |= 0}. 
0 O 0 X5 0 


(iii) (A -I)x= 


This system is satisfied for arbitrary values of all the three variables. Hence, we obtain three 
linearly independent eigenvectors, which can be taken as 


—e_ 
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x, = [l, 0, 0)’, xy = [0, l, 0)”, x, * [0, 0, 1)’. 
We now state some important results regarding the relationship between the eigenvalues of 


and the corresponding linearly independent eigenvectors. 


1. Eigenvectors corresponding to distinct eigenvalues are linearly independent 


2. If A is an eigenvalue of multiplicity m of a square matix A of order n, then the 

linearly independent eigenvectors associated with A is given by number of 
p=n-r, where r= rank (A — Al), |! Spsm. 

Remark 21 | | 


In Example 3.35, all the eigenvalues are distinct and therefore, the corr Ing eigenvec 

: L ' | ‘ Tesponding e 

linearly indenpendent. In Example 3.36, the eigenvalue A = | is of multiplicity 3 We fed ihe 
# F | in 


(i) Example 3,36(i), the rank of the matrix A — I is 2 and we obtain one linearly independen 
t 


eigenvector, 
(ii) Example 3.36(ii), the rank of the matrix A — I is 1 and we obtain two linearly inde 
eigenvectors. Pendent 
(iil) Example 3.36(iii), the rank of the matrix A — 1 is 0 and we obtain three linearly independent 
eigenvectors. | 


| 3.5.2 Similar and Diagonalizable Matrices 
Similar matrices 


Let A and B be square matrices of the same order, The matrix A is said to be similar to the matrix 
B if there exists an invertible matrix P such that 


A=P'BP or PA=BP. (3.43) 
Post-multiplying both sides in Eq. (3.43) by P~', we get 
PAP™' = B. 


Therefore, A is similar to B if and only if B is similar to A. The matrix P is called the similarity 
matrix. The transformation in Eq. (3.43) is called a similarity transformation. We now prove a result 
regarding eigenvalues of similar matrices. 
Theorem 3.10 Similar matrices have the same characteristic equation (and hence the same 
eigenvalues). Further, if x is an eigenvector of A corresponding to the eigenvalue A, then P~'x is an 
eigenvector of B corresponding to the eigenvalue A, where P is the similarity matrix. 
Proof Let A be an eigenvalue and x be the corresponding eigenvector of A. That is 

Ax = Ax, 
Pre-multiplying both sides by an invertible matrix P~'| we obtain 


: P'Ax = APo!y. 
Set x = Py. We get 
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P'APy=AP'Py, or (P°'AP)y =Ay or By = Ay. 


where B= P-'AP. Therefore, B has the same eigenvalues as A, that ts, the characterstic equation of 
B is same as the characteristic equation of A. Now, A and B are similar matrices, Therefore, similar 
matrices have the same characteristic equation (and hence the same eigenvalues). Also, x = Py, that 
is eigenvectors of A and B are related by x = Py or y = P7'x. 


Remark 22 
(a) Theorem 3.10 states that if two matrices are similar, then they have the same characterstic 
equation and hence the same eigenvalues. However, the converse of this theorem Is not true. 
Two matrices which have the same characteristic equation need not always be similar. 


(b) If A is similar to B and B is similar to C, then A is similar to C. 
Let there be two invertible matrices P and Q such that 
A=P"'BP and B=Q°'CQ. 
Then A=P"'Q''CQP=R''CR, where R= QP. 


“xample 3.37 Examine whether A is similar to B, where 


oa=[E Jeen-[! 2) ae [t J ans n=l! 4) 


Solution The given matrices are similar if there exists an invertible matrix P such that 
A=P"'BP or PA = BP. 


b We shall determine a, b, c and d such that PA = BP and then check whether P is 
c 4 


non-singular. 
Gy |? Alf 4 S| [1 2fe & Sa-2b Sa] a+2c b+2d 
= 0 = é 
ce d}|-2 0}. [-3 4}fed}' ™ |se-2u. Se} |-3a+de -3b+4d 
Equating the corresponding elements, we obtain the system of equations 


Sa - 2b a + Je, or 4a-24b-2c=0 
Sa = 6 + 2d, or Sa -6b-2d=0 
Se — 2d = -— 3a + de, or 3a +c-—2d=0 
Sc ™= — 35 + 4d, or 36+ Sc—- 4d= 0. 


A solution to this system of equations is a = 1,4 = 1,c¢ = 1, a= 2. 


Therefore, we get P = } | which is a non-singular matrix. Hence, the matrices A and B 


are similar. 








tots fe 
FITTS Fh, *,2 . 
SU MEE Miatheoniar 


1 


| 


Equating the Core 


- 4 0] ir its #2 ! 


l 
| 
Oi 4s 


f , 

(11) | 
[« il | i} 

: L ' Bil i ie | | t 

“Ponding elements. we start 


T — 1 
aa iad 


Thetetore, Weigel P = 
}. Which is a Stnwular matrix 


Since * T 
at ££ an mveny 4 ; % 
ble matrix P does not exist, the matrices A and Bare py | 
are thot sity]; 


It can be verifj 
e ventied th: ee 
at the eigenvalues of A are I, | whereas the Sirenvilues af RB 
; : d i 1 OT | are {) 4 


In practi 
ce, 1 1s usually dif% ; 
| SUAHY difficult to ob : a - 
fain a non-singular matrix Po which ALIS TES the 


A=P 'pp for 
OT any two falta te E ays 
Or Bis a diagonal os 2 Ses A and B. However, it js Possible to obtain the Matrix P ae 
ooest matnix. Thus, our interest is to find a similarity matrix P such th When A 
. gob ll iT 


Matrix . ' 
X A, we have 4 2iven 


D=P''AP or PDP '=aA 


Where D is a diagon x Ox 
gonal matrix. If such a matrix cxists, then we say that the matrix 4 IS druvonalizad| 
SLOT Ee . 


Diagonalizable matrices 


A matrix A is di eae ; 

se ; oe if it is similar to a diagonal matrix, that is there CXISTS an invertib] 

matix P such that P~ = ; ar ee ee ible 

oes aa. a AP = D, where D is a diagonal matrix. since, similar matrices have the same 

count es ae lagonal elements of D are the eigenvalues of A. A necessary and sufficient 
Jon for the existence of P js given in the following theorem. . 


Therorem 3.11 A eases as 
; “ Square matnx A of ord . — 
independent eigenvectors. reer 7118 diagonalizable if and only if it has m linearly 


Proof i 
of We shall prove the case that if A has » linearly independent eigenvectors, then A is 


diagonali 

a Let Xi, Xz, -.., X, be n linearly independent eigenvectors corresponding to the 

stiseasaes 1s A2y --+y A, (not necessarily distinct) of the matrix A in the same order, that is the 
genvector x, corresponds to the eigenvalue A,, /= 1,2, ...,", Let 


P= [x,, Moy seey x,,] and D= diag (A,, An, say A,) 


be ae diagonal matrix with eigenvalues of A as its diagonal elements. The matrix P is called the 
modal matrix of A and D is called the spectral matrix of A. We have 


AP@= A [x,, X20 -+-9 My] = (Ax), AX, ..., Ax,) 
= (Aix, A2xy, «.., AX q) = (Xj) X35 «+5 X,) D = PD. (3.44) 


sm columns ofP are linearly independent, the rank of P is n and therefore the matrix P is 
invertible. tiplying both sides in Eq. (3.44) by P™', we obtain 


P'AP=P'ppep ; 





(3.45) 





——S=——_E—— 
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which implies that A is similar to D. Therefore, the matrix of eigenvectors P reduces a matrix A to 


its diagonal form. 


Post-multiplying both sides in Eq. (3.44) by P”', we obtain 
A= PDP. (3.46) 


Remark 23 
(a) A square matrix A of order m has always n linearly independent eigenvectors when its 
eigenvalues are distinct. The matrix may also have a linearly independent eigenvectors even 
when some cigenvalues are repeated (see Example 3.34(iii)). Therefore, there is no 
restriction imposed on the cigenvalues of the matrix A im Theorem 3.11. 


(b) From Eq. (3.46), we obtain 
A? =AA=(PDP°') (PDP') = PD’P™. 


Repeating the pre-multiplication (post-multiplication) m times, we get 
A™ = PD"P™ for any positive integer m. 
Therefore, if A is diagonalizable, so is A”. 


(c) If D is a diagonal matrix of order n, and 


for any positive integer m. If Q(D) is a polynomial in D, then we get 


Q(A,) 0 
Q(D) = a) z 
0 O(A,) | 
Now, let a matrix A be diagonalizable. Then, we have 
A=PDP" and A™=PD"™ P-! 
for any positive integer m. Hence, we obtain 
QA) = PQO(D)P"! 
for any matrix polynomial Q(A). 
Example 3.38 Show that the matrix 


‘aed 


A®wil= 


= = 
ie 


oo 





Mat hematics 
Zable. Hence 
- find P such 
that P'ap: 
Is 


adaam 4 diagonal} , 
Saree. B= 425 5A + 31 matnx. Then, obtain the matrix 


[3-Z 
IA~AN =| > os | z 
| ~ «2 = 2-627 +112-6=0, & 
Since the matrix A has a ae | + © =e. 
rad 128 three d 
nce it is disgonalizable. 0 S° Vales, it has three linearly independent eizen 
ci = SV VECIogs 
~ NN NNAN cXMRCEpONIling to: the-dhpeivetees 2 =~ 





Pe. y —I} fx, fo 

(A — 2I)x=[-2 _1 oft. = |0\|. The solution is x |} 

Ma oF Ojfx} jo! If 
OSSWertor corresponding geri j ution : 
to the ¢7 faloc A = 3 is the soluti of the system 


fo 3 md fal fol 0 
(A — jx =|-2 - io! : 
ix | 2 2/|22| = | 0} The solution is x, =} 11 

So Jj -J dy 


Lo} | 
Hence. the modal matrix is given by | 
[ tid 61 -l -1 4 
Si laa Ot} and Pim} 2 4 5] 

Lirgy ~~ 9 |] 


it can be verified thas PAP = diag (1, 2, 3) 


We have D ~ diag (1, 2, 3), D* = diag (1, 4, 9), 
Therefore, A’ + $44 31= PCD + 6p 4 ar’, 


pa A 
é( ) 
a2 «4 ) 

Slee, DB *+3sD+3l-10 4 Oislo jg 91410 4 Olei0 17 9 


909) 10 0 15] loo 3] lo 9 27 


Er 


Waetrices and Eigenvalue Problems 3.69 





Hence. WE obtain 


: 1 1 O}19 Oo olf-1 -1 1a] [ 25 8 -8 
Av +5A+31=|-1 0 i]0 17 of] 2) 1 -1/=l-18 9 181. 
ft ouyo oO 27//-1 oO 1 -~2 § 19) 


Example 3.39 Examine whether the matrix A, where A is given by 


12 3 2 2 =f 
fi)A=|)02 1 Gi) A=1 2. 1-64. 
=I 2. 2 -1 2 06 


is diagonalizable. If so, obtain the matrix P such that P"'AP is a ae er 
Solution 
(i) The characteristic equation of the matrix A is given by 


}1-a 2 2 
IA-AI| =| 0 2-4 1 
- 2 2-4} 


=(1-A)[(2-4) (2-4-2 -[22-222-aJ)=0-AO-A0C- a=0, 


or 


A= 1, 2, 2. We first find the eigenvectors corresponding to the repeated eigenvalue 
A= 2. 


We have the system 
—i 2 2Zilx, 0 
(A-231)x=| 0 0 Jlix, j= 101 
j-} 2 Oljx,| |0 


Since the rank of the coefficient matrix is 2, it has one linearly mdependent eigenvector. We 
obtain another linearly independent eigenvector corresponding to the eigenvalue A = 1. Since 
the matrix A has only two linearly independedent eigenvectors, the matrix 1s not 
diagonalizable. 


(ii) The characteristic equation of the matrix A is given by 





~~} 2 -3} 
2 {-A ~6|=0 oF 2? + 47-24-45 = 0, or A= §, -3, -3. 
=—| = 72 ~ J, 


\A~ AT =| 

i 

Rigenvector corresponding 16 the eigenvalue A = 5 is the solution of the system 
-] 2 ~3 ei 0) 


+ od wo fy | * 0}, 
~{ =-2 -Silay] 10 


(A - 5I)s * 





| = = 
2/0 £ W2ineerine Mathematics 
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A sOlunon of this system is {l. 2, 157, . 


3.53 Special Matrices 
Eigenvectors cOtresponding to Z = ~3 are the solutions of the svstem 


\ In this section. we define some special matmees and study the properties of thee — = 
if 2 7 7 0 eigenvectors of these matnces_ These matrices have applications im many areas. We first :ive some 
H -.— 3 Ee oe 
= 7 : definitions. . ss 
bait =| 7 2s ee i ie * Sy - 35,58 = (x. x x,)' and ¥ = (3). ¥> ---. ¥,)' be reo vectors of dimension « m IR* or C’. Then 
{-1 ~2 3 x, |0 Let x Iv a - == 


we define the following: 

The rank of the coefficient : Inner Product (dot product) ef vecters Let x and w be nwo vectors in IR”. Then 

: inearly Mdependen: 
= = arly ind = - : i247) 
: y Tr pe rn the eigeavector (2:1. 0" sad telane | SSPE ES 2 eke 
*3 1. we obtain the eigenvector [3. 0. 1]’. The given 3 x 3 matrix has three ea. | 

independent eigenvectors. Therefore, the matrix A is diaconalizable. The aoe | 
given by 


Tmatrix is |. 





modal matrix p ; is called the inner product of the vectors x and y and is a scalar. The mmer product is also denowd 
rk | by < x, y>. In this case x- y = y- « Note thatx-x20 and 1-1 =0 if and ooh if x= 08. 
I] —? | If x and y are in C*, then the inner product of these vectors is defined as 
“4 3 L233 ; 
el Pu I O and p-'! = <|-2 4 6]. x-y=x' 3 = Fur¥ ae y-x=y a+ xF- 
=| @ |} (ioe =! et 


it can be verified that P'AP = diag 
Example 3.40 The eigenvectors of a 3 x 
[1. ©. -1}", fo, 3. —1]}’ and [1. 1. 077 


: Of l 
Mmxia] matrix r-le l 5 en m9 


where x and y are complex conjugate vectors cf x and y respectively. Note that x -y =¥- =. 
(5. — 3, — 3). 


It can be easily verified that 
3 matrix A corresponding to the eigenvalues 1. 1.3 are | (ax + By)- z= a(x -2z)~+ Bly- 2) 
respectively. Find the matrix A. for any vectors x, y, z and scalars a. B. 


Length (norm of a vector) Let x be a vector in IR™ or C*. Then 





1 22 2 
HY = Yx-e = Yap + x5 + +22 
-I -1 9 


oS =—_ & 


0 is called the /ength or the norm of the vector x. 
Unit vector The vector x is called a unit vector if ix} = 1. If x + @, then vector x/!ix\\ is always 
- | 1 -1 i @ Unit vector. 
i | | 
We find that _ sin] i= Orthogonal vectors The vectors x and y for which x - y = 0 are said to be orthogonal vectors. 
I 4] 1 Orthonormal vectors The vectors x and W for which 
| x-¥=0 and izi= llLiwi=1 
Lo. FEO GIT <i =] 

Therefore A=ppp'-! I 1/0 | Ol—1 1 -l are called orthonormal vectors. if x, ¥ are any vectors and 1 - vy = 0, then x/fixi. yijy|! are 
“t-¥ ot ONG o all ¢14 4 DER SNICE ICL TE GANAS SOO SF AEN 


1} {O) (0) 
(i) f } | 10] form an orthonormal set in iR°, 
O} (0 l 











ih: 
. _/e 
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"gineering Mathematics gominant matrix A matrix A = (@,;) 1S said to be diagonally dominant, if 
piogon al? n 
(ii) | 4i |, 3i},] 0 | form an orthogonal set in C* and | 4;/ 5 w/5 ae 
0) O} ll4i 0 0 i) : f equations Ax = b, is called a diagonally dominant system, if the above conditions are 
‘ — (l+i)/J2 | The een ihe strict inequality is satisfied for at least one i. If the strict inequality is satisfied for 
orm an orthonormal set in C3. satisfied ae? si called a strictly diagonally dominant system. 
| ay then 
Orthonormal and unitary system of vectors Let x,, Xo, ..., X,, be a vectors in IR". Th allt th xtrix A matrix P is called a permutation matrix if it has exactly one | in each row 
set of vectors forms an orthenormal system of vectors, if * INEn, this utation malr 0 
Perm jumn and all other elements are 0. 
= - = oO : * . = 4 # 
Moxy xi xg = I ti = fa matrix Let B be a sparse matrix. Then, the matrix B is said to satisfy the property 
: lL isy proper) e ee if there exists a permutation matrix P such that 
Let X), X, ..., x, be 7 vectors in 0”. Then, this set of vectors forms a j A, if an 
, N uNitary system of vectors, jf opr’ = a = 
Xj" X= x} X, = ae Az, An 
LL P=; 
In section 3.2.2, we have defined symmetric. skew- 


symmetric, Hermitian and skew-Hennitian 
matrices. We now define a few more Special matrices. 


A,, and Az» are diagonal matrices. The similarity transformation performs row interchanges 
where A j| 
Orthogonal matrices A real matrix A is orthogonal if AW 


; diagonal 
ed by corresponding column interchanges in B such that sat = Se ni 
P follow The following procedure 1s a simple way of testing 7 han cael ie ine cistoie-s al 
= A’. A simple example is pale, form. It finds the locations of the non-zero elements an 
wire . , 
‘hee cos@ —-sin@ eA 
sin@ cos@| 


A linear transformation in which the matrix of 


i i the required form. Let 
ing inter jumns are possible to bring B te 
7 ding interchanges of co 
rows and correspon 
orthogonal transformation. 


= _ Let there exist disjoint 
be the order of the matrix B and b, #0. Denote the set U = (1,2, 3,.-...7} 
it 


ff diagonal elements 
U, and U, such that U = U, U U;, where the suffixes of the non-zero off ciago 
transformation is an orthogonal matrix is called an subsets U, and U> 


ix B 
pa je U,, k € U,). Then, the mamx 
b, #0, i #k can be grouped as either (i € U, ke U,or(ie Up KS ” 
Tk 2! a 7 1 : 
satisfies property A. 
Unitary matrices A complex matrix A is unitary if A”! = (A)’, or (A)! = A” If A is real, then i-2 1 ; 
unitary matrix is same as orthogonal matrix. Consider, for example the matrix B=| 1 3, ii ‘ 
A linear transformation in which the matrix of transformation is a unitary matrix is called a unitary 0 “ 
tranformation. 
We note the following: 


1. If A-and B are Hermitian matrices, then @A + GB is also Hermitian for any real scalars 
a, B, since 





(@A+ BB)’ = (a@A+ BB)’ = aA’ + BB’ =aA+ BB. 
2. Eigenvalues and eigenvectors of A are the co 


2 1 Oojf1 0 0 

1 0 O||-2 

; : : > 0 0 1 

igi njugates of the eigenvalues and eigenvectors Thea: ppp’=|0 0 | : : “| ae 
Ax =Ax gives AX = AX, 

3. The inverse of a unitary (orthogonal) matrix 


at Rare! 2 
is unitary (orthogonal). We have AW = A . 
Let B= A~'. Then 


B™! =A = (ATy! < ayy nee [((A7! yy" = B 


aR: > ant -2 0 K _\An P| 
; —2?|=} 0 -2 ta A>, “1 
0 








3, say Wier; . 
LINC ering Methesyery; 
iy 


Where Ay, and 


Ass are dy 
Irans formation jx er ‘este 





Matric. 
atid S equivalent to TES ces Hence Bh 
sae Changin : aS proper, 4 
Noy © POWs 2 and 3 followed | Note that the ab, 
Yo ad, gt 0. fs = . 'OWed by an ; §Bowe o . 
? eg ‘ l. 2. 3 ¥ an Mlerchan Cc SIMilari, 
> Je £} . @in#Q Be of ) 
Pie's se, 0 Me FO ae yt, ! Sy 8 EG “elumns 3 
Tre we 3} = c" Ls U,. He 2 2 = uy... Subse a4 tf+) = 0). 3 = u i 
We now establish ~ SACE, matrix Bh me = ar ae Die 
ish “Ome important 145 Property A a> ¥ rf CXist sigh =, 
Therore results a4 ch th 
orem 3.12 4 = 
“Wn Ortho f r 
Proof a £0nal set of ¥€ctors is linearly ing 
: TP neay . - in 
Cquation Xn, De an Orthogona | €pendent. 
S¢l Of Vectors, thar i 
| » EO mp tei 
= : SIder th 
[= 4 e 
We get a+ s+. Q@ are SCalars. Taking the inner rod he (3.4 
Pp uct of the Yector x in Eq G 48) = 8) 
% . = = With 
or xy (a,x, + .%, =. + Xt, 
a — fg X on) — xy => 0 


cry (x, . x,) = 
Since ix, ||? 
SUCCEssively 
waey X 


* 0. we get @ 
Ivery, we find that a, = a,= = 
m 'S linearly independent. ; 


Theorem 3. 


‘ae 


13 The cigenvalues of 
(1) an Hermitian mat 

(ii) a skew-Hermitian 
(iii) an unitary 
Proof Le 
Ax = Ay 


riX are real. 


A be an cigenvalue and x be 


Pre-multiplying both sides by x 


Not x7 x 
e that ¥’ Ax and x" are scalars. Al 


O or a xf? =o 


imawix are of Magnitude |, 


= 


larly, taking the inner 


Products of ; 
= = * : 
@,, = 0. Therefore, vonal at 


th i 
© Set of Orthogonal Vectors x XK 
Ir Ad, 


Matrix are zero or i i 





re. ae (3.49) 


x 4 2 = ; 
SO, the denominator x7 x is always real and positive. 


Therefore, the ‘t A 
behavior of 2 is £overmmed by the scalar x’ Ax. 


(i) Let A be an Hermitian matrix. that 





ee ee , 
(TAS) = yy ARax' alee 


since x’ A’ T isa scalar. Therefore. 
real. 


is A= AT. Now. 
ix" A*s\7 —57 4, 


= 7 j 
x AX is real. From Eq. (3.49), we conclude that A is 


(u} Let A be a skew-Hermitian matrix, that is A’ = —A. Now. 





ay ee oro rT 
(¥°Ax) = 3° AT=-x’A'3 





= -(x’A’d)7 =~ x7 Ay 
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ae ~'A'’x is a scalar Therefore. \ 
$l! ea te 


conclude that A is zero OF pure imaginary. 


Giiy Let A be an unitary matrix. that is A! = (A)! Now, from 
iil 
Ax =Ax or AN = Ax 
x) sz =r\l ee erie = =F 
we get (A x) = (437) or & A’ =AX 
or SAC RST 


Using Eqs. (3.50) and (3.51). we can write 


(x A "ytAxD = (A tWAx) = Ay xl x 
or x = [AP Ss. 
Since x + 0. we have X¥’ x = 0. Therefore. P= 1.or [A] = |. Hence, the result. 
Remark 24 


From Theorem 3.13. we conclude that the eigenvalues of 
(i) a symmetric matrix are real. 
(ii) a skew-symmetnc matnx are zero or pure imawinary 
(iii) an orthogonal matnx are of magnitude | and are real or complex conjugate pairs 


Se 


: : a 1 7 i 
AX IS Zero or pure imaginary. From Eq. (3.49), we 


Ved 
i 
=) 
— 


(3.351) 


Theorem 3.14. The column vectors (and also row vectors) of an unitary matms form an unitan 


system of vectors. 


Proof Let A be an unitary matrix of order mn. with column vectors 1,. x... ». Then 
x} Ry, X, X, 85 ii ae 
tH pena 2 aT = 
r = x, Xs%, “x vo X 
A i AA = = [X), Xs reo X,,] = pie i. I 
x! Fi ale. tx 
= O, zx; 
Therefore, “eH 1, = ‘ aaa 
. #=7 


Hence, the column vectors of A form an unitary s¥stem. Since the inverse of an unitary matmx ts also 
aN unitary matrix and.the columns of A’ are the conjugate of the rows of A. we conclude that the 


rOoW vectors of A also form an unitary system. 


Remark 25 


(a) From Theorem 3.14, we conclude that the column vectors (and also the «ow vectors) of an 


orthogonal matrix form an orthonormal system of vectors. 
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(b) A syin 
diagontizatie “MX Of order ,) has » linearly independent Civenyve 
Examp! 
. e 3.4] Sho 
: ” = W tha 7 — i 
cigenvalyes thisieinn at the Matnces A and A’ have the same eigenvalue 
eenyvectons “rresponding to 4 and A‘ are mutually ortho pay Fisting, 

Solution We have ; Zonal, 


IA~Aj}= (A‘)? — Aq?) = [AT - ANT) =) a7 _ All 
have the “ame characteristic equation, they hay 


e the same eipe 


A. Let x be the ewenvector ©Oresponding 
ector Corresponding to the e; wee 


NValues, 
(Wo distinct eigenvalues of 
A and y be the eigeny 


ltiplying by y”, we get 


We have 
y"Ax= Ay’x. (3 
ae, 
We also have Aly = HY. or (A’y)! = (Hy)” or ya a uy? " 
Post-multiplying by x, we yet i 
yAx = py" (3.53) 
Subtracting Eqs. (3.52) and (3.53), we obtain 


(A - p)y"x = 9. 


c.. . 
Since A HM, we obtain y’y = 0. Therefore. the vectors x and y 


"are mutually Orthogonal. 
3.6 Quadratic Forms 


Let x = (Xb, Kay von, x,)" be 


an arbitrary vector in IR” 
expression of the fonn 


A real quadratic Jorm is an homogeneous 


Oe LL ayaa (3.54) 
fol ye} 


in which the total power in each term is 2. Expanding, we can write 


ie, = a) yx + (ay> + és, ) vy As + o- T (a,,, ue a,,)) x xy 


» 
+ Was VV = (a5, + >) Xv; +; + i. Ft (d5,, + a,,>) Vs ‘i, 


+. Fee 
= xAx (3.55) 
using the definition of matrix multiplication. Now, set by = (ay + ay)/2. The matrix B = (by) is 
symmetric since hy, = 6,. Further, b, + b, = a, + a,,. Hence, Eq. (3.55) can be wtitten as 
O= x'"Bx 


where B is a symmetric matrix and },, = (a, + a,,)/2. 
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% aD 3 Lem 
For example, for n = 2, we have 


by = ay by = by = (ayy + ay,/2 and Dy = An. 
Example 3.42 Obtain the symmetric matrix B for the quadratic form 
(i) O= 2x4 + 3x x5 + x4. 


ae 2 se 3 5 
(iil) O = x) + 2eyxy - 4xyxy + Gary — 5 x3 4 4 2. 


Solution 
(i) Ty) = 2. ayj> + tly, =4J4 and fia5 = 1. Therefore, 
l 3 a ~ 
My=ay=2, b= 6, = > (a). + @3,) = > and 6 = ay = 1. 
2 3/2 
Therefore, B= aia 4 | 
(it) ay) = 1, ay2 + ay, = 2, aj, + ay, = - 4, dx, + dy, = 6, ay = -5, ay, = 4. Therefore, 
_ sot. seal | _ 
by = ay = 1, by = hy, = > (a\2 + a3,;) = 1, by, = by, = > (ay, + ay) 2, 
= = = — = = J 
by, = by = > (@23 + a3,) = 3, Ox = ay 9, 63; = ayy 
J | —2 
Therefore, B= 1 —§ 3}. 
—2 3 4/| 
If A is a complex matrix, then the quadratic form is defined as 
n n 
= > F: ayy X;X; = x Ax (3.56) 


fel f=) 


where x = (x,, x5, ...,x,) is an arbitrary vector in C". However, this quadratic form is usually defined 
for an Hermitian matrix A. Then, it is called a Hermitian form and is always real. 


| l+7 


For example, consider the Hermitian matrix A= cy 


. The quadratic form becomes 
I L+i]] x, 


|-j 2 ty 


O= xX’ Ax =|x,,x, 


7 


‘i =|yPra +a Xt (1 = eyez + 2 |xp/?. 


= 2 
= |x + (xp + 4) + HE, ~ 4%) + 2faxyf, 
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Now, Xs + V)¥> 18 real and ¥,1,— 7,7 is Imai 
> Vy) Va i ATT aT : un ifs, = 
8 oe Fs afinary. For example if vy = py F ig,, 


x3 + x, F, = 2 , : 
a Es = 2s + gga). and M2 — XX = 2 P\q2 - prg,) 
We can also write 


(1p. + ¥547,) + ~ 
[3 a i) ix, A) .T> JV 1X5) = 2[(p,p, + + Gyqs) = (j? ef a Poay,)] = 


to 


Re[(l + )X x5]. 
fe > . 
erefore. O= IxP + 2Re [(1 + F195] + [vol 


Positive definite matrices 


Let A = (a..) be a sais © i . . 
(a,,) be a square matrix. Then, the matrix A is said to be Positive definite if 


—_ =F = r 
QO = X" Ax > 0 for any vector x + 0 and x° Ax = 0, if and only if x = 
If A is real, then x can be taken as real. 


Positive definite matrices have the following properties. 


The eigenvalues of a Positive definite matrix are all real and positive. 
This is easily proved when A is a real matrix. From Eq. (3.49), we have 
A = (x"Ax)/(x"x). 


™>0O and x’Ax > O. we obtain A > 0. If A is Hermetian, then XK Ax i IS real and 2. 


is real (see Theorem 3. 13). Therefore, if the Hermitian form O > 0, then the eigenvalues are 
real and positive. 


Since x 


2. All the leading minors of A are positive. 


Remark 26 
(a) If A is Hermitian and strictly diagonally dominant with positive real elements on the diagonal, then A 
IS positive definite. , 
(b) If x’ Ax 2 0, then the matrix A is called semi-positive definite. 
(c) A matrix A is called negative definite if (— A) is positive definite. All the eigenvalues of 2 
negative definite matrix are 1cal and negative. 


Example 3.43 Examine which of the following matrices are positive definite. 


1 0 j 
s F | 3 —2i 
(a) A = , (b)An/|" "| (c) A=] 0 1 O}. 
2 4 2i0 4 
-i 0 3 
Solution 
3 Ife, 


(a) (i) O= x"Ax = [x x] 


= 3x; + 3xjx, + 4x4 
2 4 xy S =~ 





ly = = 
= PEt ig. 


(il) 


(iil) Leading minors |3| = 
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_ 2 


=3{x,+4,,| + 2 >0 for all x # 0. 
A ak oe 


Eigenvalues of A are 2 and 5 which are both positive. 


3 | = 
| = 10 are both positive. 


Hence, the matrix A is positive definite (it is not necessary to show all the three parts). 


(b) 2 = 


Taking x 


= (x1. ¥2] 2i 4|| x, =[5.%] 2ix,; + 4x4 


= 3x, X; = 2iX,X + 21x, X>5 + 4x. . 


= p, + iq; and x, = p+ ig2 and simplifying, we get 5 


O= 3 (pi + ai) + 4 (pat G2) + 4 Wid - PW) 
= pi + gi + Ips + 2g3 + Up2- GY +2. t+ 42¥ > 0. 


Therefore, the given matrix is positive definite. 


Note that A is Hermitian, strictly diagonally dominant (3 > |- 2, 4 


> |2i|) with positive real 


diagonal entries. Therefore, A is positive definite (see Remark 26(a).) 


(c) O= X'Ax= 


[X,,%> et | 0 ] 0 xy = [*.*3, x;] Xy 
—j 0 4 Xy —iX, + 3x, 4 


= x, + iX,X3 + X2¥q — xX + 3X5; 


I 


Taking x, 


Therefore, the m 


QO 


= py + iy, Xz = P2 t 14a %3 


—— 
— 


\x,/° * \x3I° 7 3)x;1° + i(XyX3 — 455) 


= p, + ig, and simplifying, we obtain 
(p? + 2) + (ph + g3) + 30p3 + 93) — 2P 43 — P34) 
(p, — 43) + (Ps + a + (Ps + 93) + 2CP3 + 95).> 9 


‘ be cA 
atrix A is positive definite. It can be verified that the eigenvalues of ¢ 


are 1, 2, 2 which are all positive. 


Example 3.44 Let A be a 


eigenvalues. 


T Ty 7 
Solution Since (aT A) = A'A, the matrix A 


are all real. Now, 


. r Te 
real square matrix. Show that the matrix A’A has real and positiv 
. lues of A’A 
Ta is symmetric. Therefore, the eigenvalues 0 


x ATAX = (A x)(A x) = yy, where Ax = ¥. 
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Since y'y 


> 0 for any y 
of A'A ar or any vector y =O. t 


© Positive. Therefore 


Nature 
| > Tank inde iis 
) xX and signa 


form Q is said to be quadratic form Q=x' Ax, where A is a symmetric matrix. 


POSifive 


: 1 rt ‘ a's . £ 
| he matrix A7A is positive definite and hence all the 
all the eigenvalues of A™A are real and Positive. 


"igen Values 


ture of a quadratic form 


The qu Adratic 


definite if all the eigenvalues of A are real and positive, 

negative definite if all the eigenvalues of A. are real and negative, 

— positive definite if all the eigenvalues of A are real and non-nevative, 
Semi negative definite if all the eigenvalues of A are real and non-positive. 
indefinite if some eigenvalues of A are positive and some are negative. 





This defines the nature of the quadratic form. 


Rank of the quadratic form The rank r of A is called the rank of the quadratic form, thay ; 
the number of non-zero eigenvalues. . ’ is, 


Index of a quadratic form The number of positive eigenvalues is called the index of the quadratic 
form and is denoted by k. 


Signature of a quadratic form We define 


Signature = (Number of positive eigenvalues) — (Number of negative eigenvalues) 


i 


k - (r —#) = 2k = r. 
Signature can be a negative integer. 

We now, prove the invariance of a quadratic form under non-singular linear transformations. 
Theorem 3.15 Under a non-singular linear transformation, a quadratic form x7Ax, remains a 
quadratic form. 


Proof Let x’Ax bea quadratic form, where A is symmetric and xX = (X,, X%, --- xy Let a Py 
be a non-singular linear transformation, which transforms the quadratic form from the variables 


Hie Koy seu Ky LO My Bae cosy ¥,. Phen, 
x7Ax = (Py)’A(Py) = y’ P’ APy =y’ By 
where B = P’AP. Now, 
B’=(P’ AP)’ = p'a’p = P’AP=B. 
Hence, B is symmetric and y" By is also a quadratic form. 


This proves the invariance of a quadratic form under a non-singular linear transformation. 


3.6.1 Canonical Form of a Quadratic Form 
rms such as XyXy 


A quadratic form Q = x’ Ax is sai! to be in canonical form if all the mixed te vf squares 
umn Of 5G 


¥,X3, --- are absent, that is, a, = 0, /#/. We may also say that a canonical form is a 5 
form. The canonical form is, therefore, given by 
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Oa Vi tats. tay (3.57) 

yee" ; . 
yank i QO= 4, ¥, 7 a2, 7. TAY y (3.58) 
jad here @ Gia, «+++ 2,, AFC any real numbers. 

= |i, w et 
fank (A) _ 6x2 + 5x3, OF= 3x7 — 4x3 are canonical forms. 
ample. = 

For ex 

7 Fe hee Pe 
gemari ? -~ A is symmetric, it is diagonalizable. Hence, every quadratic form O = x Ax can be 
gince the matrix of squares form. The number of square terms is equal to the rank r. 

a sum 5 ; 
a orthogonal transformation x = P y, where P ts an orthogonal matrix, seme 
theorem 3.16 “ = x™Ax to the sum of squares form Q = y D y where D is the diagon 

- fm 1 —_ 
yadratic fo! ! 
x, D = diag (Aye Azy seve Ae) tric matrix. Let P be 
se k of the quadratic form QO = x/Ax be r. Now. A is 2 Symme . 

t the ran a ? 3 
seas modal matrix of A. Therefore, 
the no 

er ow dieg Cy ta Ad: 
are _ pap = _ where D = diag (4), 42 + “r 
p-' A P= PAP lo | 
r =n = ig A * A, oes Any: 2 
Ifr=n, then P’AP = D, where D diag (4; dad 
: =Py, weo : 
Under the orthogonal transformation X y 5d 
: ae: i ; = Tt ¥ 
2, 0 
X> ¥| ‘ 
" Y2) =A, yi ra2 v3 se t Ae Ye Gen 
= [v), V3 4 Val | h, | ia 
0 0 ‘ Va 
0 
2 + A ys + ... + An Vir : alive. 
' aes ,~ k coefficients be neg 


If rank = - = we get A,. i 
‘mca aie in Eq, (3.57) be positivs ane first and then . 


{tk coeffiecients in the sum 0 nana the terms with positive a 

Arrange t in Eq. (3.57) suc :s arranged as 

thes £ the terms in Eq. ( ecieiite $7) is 3.60) 
etms with negative coe! = ets Vee 


fficients appear 


That is. Eq. (: 


— G4) 41 * 


+a, Vi 


2 oe 
O= a, Vi + ay Y3 


Where a, > 0, 








3 ren 
‘1gnaty “© betw dratic , 
re ee MC fo 
A \ i ud the Quadra the Number eg The Number 
YiVeste, S Io 'C form POSitive OF Positive t 
real, non aw DF inertia T and Ne Bative a“ emis k 1s Called tl 
Red ~mBular transform.” any 4nd ing eS ck» - ae 
e€duc ations Cx k of Calleg 
mo8 OF quadr * Teal quadratic form ™ 
We gi Atic fo Q 


Sing: Let 


reducing rm 
Jaa i 
& 4 quadratic form to a Canonical 

nical fo 


1 |* Ds 


*y. We wr 
te the 
mL) 


rm —- 
3:= eaten ee te r\X,ory=p 
L , x4, 0 0 | = X, (3.6) 


quares form be gq 


2 
| Yi + bys 
lerms with - 


and compare the the terms in th 
nt 


+ cv3. Substitute (3.61) in 
| € given quadratic fj 
2. Orthogonalisati Macratic form. So 
Satio . , 
se ila Find the eigenvalues and eigenvectors of A. Obta; 
- Under the transformation x = Py, the quadratic form a tain the normalized 
duces to 


: mr ).¥ | as A > T «ceo £ V - depend} Ay + Asvs + 
eigenvalues of A. ay, G€pending on the rank of A, where A's are the 


ave + by? 
- | 3 


+ cy? : 
“hy Simpy 
lve for a, plify 


Py q, br ande 


Ex I ¢ th ic + 
ample 3.45 Reduce the quadratic form 2x7 + 2x5 + 2x4 = 2x 


| | (Xy — 2X2%, — 2xyx, to canonical form 
through an orthogonal transformation. Find the index and si 7 ™ 


gnature. 
Solution The matrix of the quadratic form is 


x mf J] 
Ama} 2 —J] 


= 9 


Eigenvalues of A are 0, 3, 3. 


. : ; Tr 
Eigenvector corresponding to A=0,isv, = [1 1 1]- | _ 
e have the equation for a finding the © aa 
s v= [1 0-1)’, Since the model marie 
e above equation and also be wit ai 
and v>, we obtain ¥3 ~ es 


Corresponding to the repeated eigenvalue A = 3, w 
as x, + x2 +x; = 0. One eigenvector can be taken a 


I —_= ; 3 


The normalized modal matrix is given by 


vJl3 yl2 V6 
p=|w3 0-26 
ys -vv2 6 


Lal 
a 
‘ad 
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nsformation is x = Py. and 


onal tra ; 
au | form = x/AX = y’PTAPy = y’Dy = (0) 7 + 393 + 393 = 392 + 313. 
onical - 
os =. signature ~ 2. 
in 
Condition Number of a Matrix 
i tix Let A bea real or a complex matrix. Then. the norm of a matnx denoted by || A}), 
ma 
norm of 3 


"defined as follows: 





(i) Euclidean norm, ij All = diais 


} norm or Hilbert norm: Compute A’A=(A) A. Define | | 
4. = spectral radius (largest eigenvalue in magnitude) of A A. 


tit Al] = VA. 


if A is an Hermitian matrix (A 
4 = spectral radius of A A= spec 


Therefore, ||A|| = JA = snectral radius of A. 


fii) Spectre 


= A) or A is a real symmetnec matrix. then 
tral radius of A> = (spectral radius of A)”. 


For most engineering applications, we use the spectral norm. 


Condition number of a matrix aii 
Condition number of a matrix 1s an important concept in the si Aestapoee = = se 
equations. In engineering applications. we often require to solve a a aes Gneniiee avhods 
equations. Since the system is large, we solve it by Heralive Dist 0 Condition number 
produce round off errors. The round off errors should not magnify during wick of the sensitivity of 
of the coefficient matrix A of the system of equations Ax = b,, gives a MEAS = 

the system to round off errors. 


‘Ti | matrix A as 
Using the spectral norm, we define the condition number of a 


| a [2 (3.62) 
cond(A) = K(A) = HAI ATE = Vi 
where A = largest eigenvalue in magnitude of A a 
n magnitude of A A. 


.- matrix. then (3.62) simplifies to 
If A is an Hermitian matrix or A is a real and symmetric matrix, then ( ) simp 


and = = smallest eigenvalue i 


a= (3.63) 
cond(A) = K¢(A) = AK 1A ‘i fo 


magnitude of A, 
magnitude of A. 


Where A, = largest eigenvalue in 


and Uy, = smallest cigenvalue m 





— “WE Meering Mf j aa 
ee MOM erry 
bi larger the valine ty 
Oy CXAMple. wh ry Of the Condit 
Places Arithmer, “Re cong 'On number 
arithmetic Metic may diffe Illon number ‘Sin IS the Sensitivit 
Sale, " Completety ¢ 78% the sohas ) oF the sys 
YF mane solut _ o¥Stem t | 
We can use oth TOM the Solution ion obtained Using 2 Found off 
er norms | Obtained b Y. four 
Example 3 das S also tg compute th ¥ Say, six decima 
= 9 “In J ¢ c * 
the Condition umber ion: number. 
3 Of the fol - 
(1) : | if =—2 @ nae matrices, 
> (li) |» 63 ; 
0 5 (iii) = 344; 
Solution z oe og 
(1) A is real, We have 
Ik Ficmesactics * 2313 2] fio 29} 
Facteristic equation of A’A is given by 
[ATA = aa = lO—A 10 > é 
The eigen : , | 
: ‘<Biak are given by 2 = [15 + 575}, [15 — 5V5], 
Largest eigenvalue in magnitude of A7A = A, =[I5 + 5V5]. 
Smallest eigenvalue in Magnitude of A7A = M, = [15 - 55}. 
Hence, : cond(A) = fal = HS+5v8 = 2.618. 
Hy = 
(11) A is real and symmetric. The characteristic equation of A is given by 
5-A_ -2 0 
: 4 te 
IA-AN=| -2 6-A 2 | =A? - 180? + 990 - 162 = 0. 


0 2 “fee 
The eigenvalues are given by A = 3, 6, 9. 


Largest eigenvalue in magnitude of A 


conten” Smallest eigenvalue in magnitude of A 






wa, 
3 
Hence, 


the generalized diagonal matrix 
elsewhere. 
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omplex (Hermitian) matrix. We have 


. om  { 2. Sen 2 BSrarp_| 29 oe 


|= «9 - a7" 400-0 


haracteristic equation of A’A is given by 
The © 


29-A 12+16i 


JA A-AIl= | 15 16; 29-a 


The eigenvalues are given by A= 49, 9. 


Largest eigenvalue in magnitude of A A = A, = 49. 
Smallest eigenvalue in magnitude of A A = Ht; = 9. 


: A)= 2 - [%=4 
Hence, cond ( i, 9 3 | 


i 1 \ rmula 
0 


Largest eigenvalue in magnitude of AL 7 
ca il Smallest eigenvalue in magnitude of A 3 


3.8 Singular Value Decomposition 


re . { 
| ie lications in many areas © 
a , cept which has app ci 

: ecomposition is an important con : ‘soonalization of a square 
—. Te ee etc. In an earlier section, We emgage am real or a complex 
chee We ‘now scust diagonalization of a rectangular matrix » i 
matrix. : : r | matrix. 
matrix, We shall discuss in detail the case when A Is a rea 


= here D is a 
decomposed as A = PDQ, w 
1 x mn real matrix A can be | ; r ordety ant 
ool ia te eather m x n and P and Q are orthogonal matrices OF © 
generalized diag 
and n x n respectively. sti + defraine rnatrix 
“ he 2 Xn matrix B= A’ A. Now, B is a symmetric and positive semi-detin 
Proof Consider the ” 
since ; (3.64) 
pr=(A’a)’ = A'A=B ai 
2 ; 
x™Bx = x’ A’ AX = (Ax)’ (Ax) = AXI @ : zero 
and : itive or zero. 
seam m x anita vector, Therefore; the cigenvals oF 8 2" VT ae we 
aca oi ae of Bas 4, =H i =: Ha oon a e order the eigenvalues such that 
Denote the eigenvalues if some of the eigenvalues are ZETO, Ww ‘crank (B) = 7. then We nee 
Se M Te ee taken first and then the zero cigenvalucs. n 
€ non-zero eigenvalu | , 


the r positive eigenvalues a5 Pty 


wena Hy» Define 
ro eigenvalues aS Hy +1> fT dere ) 
a = eS aeait m4 mu on its diagonal and zeros 
D of order m * 1, with ply, Hay +> Hr 
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Find the norm 


fhires-an A alised eigenvectors of B 


rthonormal System. That is 
i 


and denote them 
Uy, Us, Tene ul 


a5 u,, uy, 
oe | ae 
a are SOlutions ar The TOMMAlised 
igen 


Bu. = a’ z 
and ‘ A A u; 7 Hy u,. 
eR. Eee 
~Hesy, (3.65 


Now, form the Orthogonal matri 


Now, |] Au,|/? * 2 with af, af... 


= (Au,)" (Au) = u) A’ 
Therefore, II Au, ||? > 0, Si Tm 


fay u’ os its 
aT ro 
Au, = g7;,7 we. 
a HG (a; Ww) = pe 
we 


or | 
and ll Aw,|}? = 0, for i _ 


i ees PY Leese 
Tomes 


This implies that Au, a5 
Fe ire? 


Define | sie ae 
the vectors Viv V2v «++. ¥, SUCH that 
(3.67 
¥, = I | 
Fi no i= l, 2, rs 
Now, r ! se 
eye r 
i | (Au,)' (Au) = —! - 
Sibi sf Hig OOD a NOP nye By 
SY = 1, fort=;= 7 9 = f Mi; pe, j W, 
Therefore, v;, V> - fo an ¥, ¥ — 0. i ol | 
S55 Vy Seah tha Sey Hai: pacers System. Since r < m. we Select th oe 
a ae E normal system with the Weeks © vectors Vesey ¥ 
i die = arbitrary. Define the m x m matrix P sik» Vie Var -..5 ¥~ This choice of 
1s "2 +--+) Vn]. Note that P is an orthogonal matrix *¥te V2 so Yop form its columns 
s 
= Vv; vi 
ow, Tanr_|ve r 
PPAQ’ = |"? Afu,, uw, ..., uJ =| ¥2 
os ! Fa 7 al [Au,, Ally, ana Au,] = (c.) 
_- # 
, 
Vn vi 


Therefore, P7aqQ’™ 


defines an m x n 
matnx whose elements are m 
From (3.67), Au, CSMIENS are cy, 


= v) Au. 
= 0, for j =rt+lrt2. 
From (3.68) and (3.69), cy 


Therefore, P74 


: --+y A. Therefore, ce, = 0, fory=r+ l,r+2, ....m 
=v An = Ti — 
‘haan j Au, H; V; ¥; = Mp for i =; = 1, 2, ---, F; and O for i # j. 
es : . : 
the mx n generalized diagonal matrix D, that is P’AQ’ = D. 


Pre-multiplying by P and post multiplying by Q, we obtain 


r 
7 P(P’AQ’) Q= PDQ, or A= PDQ, 3m) 
since P and Q are Orthogonal matrices. 
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a : 
numbers Hi, Hz 
lar values of A. 


of the non -Zero 


oat and the 

decomposition. 

= PDQ, is called a singular aH we are called the sing 
| r 


‘ == . f Lt}. jo. = = 
The deco h sitive square Toots O° Ft _ Since, ee r value 
pene yaa ee Singular values are Pe SS _® _ v,, is arbitrary. singula 


fa matrix is not unique. 


owing decompositions: 


eigen uige 
decomposition o 


we have the foll ea P32 D..5 O33 


For example, 


23 3 " 
A 


where D is suitably defined. 
Remark 28 eww, 
Wi n determine v; in an alternate way. From (3.68), we ha 

e ca 


ye et 
But from (3.66), we & ; 
AT Au, = Hj Uy OF Alu, v) = Hi Ue 


= 3.71 
A(A’ v) = w(Au). OF (AA’)v; = Hi *r f ) 


| r 
or : 
s of AA’ and v; are the normalised eigenvectors of AA’. 


: 4 
fore, uw; are also eigenvalue °: | a 
thats aa determine v; by solving (3.71). If rank (B) = r. we determine V,.\, V-+2 


as described above. 


Remark 29 3 

if A is an xn real symmetric matrix, we have B = A’ A = A’. The eigenvalues of B are a 
eigenvalues of A. The eigenvectors U); U5, ni ini | and Vi> Wie oa Ve are identical. There ore, 
P’ = Q, or P = Q’. In this case, singular value decomposition is given by A = PDP’. 

Remark 30 

In the case of a complex matrix, we have the following result: 

An arbitrary m x nm complex matix A can be decomposed as A = PDQ, where D is a generalized 
diagonal matrix of order m x n and P and Q are unitary matrices of orders m =< m and n xn 
respectively. 

Example 3.47 Find singular value decompositions of the following matrices. 


. fl 2 1s pra 
m i - ) |; st Git) |1 1]. 
I 1 


Solution 


(i) We have B= ATA =| al 373 a 
2 3ij1 3 5 137 


Eigenvalues of B are given by A> - 154 +1 = 0. 
We obtain a, = yr, = 14.93303, 2, = 42 = 0.066966, 4, = 3.86433, pp, = 0 25878 
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\ 
=) 


on 1s A= PDQ. 
Ic The eigenvalues of B =A A are Sq Uae OF Sige} citi . 


decompos!t! 
ry he acre er ed . 
given by A = PDP’ = Q'DQ. The eigenvaises o° A 


al and symmetr 














¢ decomposition Is 


The diagonal matrix D is given by 
4 piven 1 valu 
p = | 386433 sg F 1H The singular V af B are 100, 0. 
: 0 0.25878} m gs 10, 0- ee x D is given by 
€ eigenvectors a : = .,conal ™m 
are obtained as the fo] lowing: The diag? 10 0 
= D ~ 
A, 14.93303- xX, = (0.38661, 1]’: u, = x) = [0 36060 Q) 0 
| = : * 0,93 r ! 
x | 272)’. .. fr 3}fr 3]_pe 3 
A, = 0.066966: 2 = (1, ~ 0.386607)": y, = 2 _ 4 BHAA ls olla 9] [30 
Hae a4 [xj (093272, ~ 0.36060)" Now, 
e matnx Q is given by ectors are obtained as the following: 
r ope =e = eh, Spee = —L =[I/vl0, 3x10] 
Q=|" | = [935060 0.93272 . fo ele a ae 
—_ uy 0.93272 ~0.36060 |" ; oe 
es that Q is an orthogonal matrix. oe 1": u; = sat = (3/10. /vlol 
cline the vectors v,, v> as the following _ = 
v,=— au, =! _[! 2][ 0.36060 _ [0.57605 The matrix Q is given DY — 
My 3-86433/1 3] 0.93272 |" 0.8174)|" u7 |_| wio 3/10 | 
=} orl | aio vio | 
al “ Any = = 1 2/} 0.93272] [ 0.81737 “s ‘ 
2 29878 | _ mi , ‘ 
3 }|-0.36060]" |-0.57609 Note that Q is an orthogonal matrix. We have 
vv10 —¥ VIO | 


The matrix P is given by 


P= [y, v5) = 0.57605 0.81737 
| 0.81741 -0.57609]} = 
Note that P is also an orthogonal niatrix. The singular value decomposition 1s A =~ acl 
The vectors ¥, are solutions of (AA’) ¥; = [ee v,. We have Hk 1] is 37 
| = ; 
ay } If= “t 
7 We have B=A‘A= | } fe 4 
| J 3/2 3 7 10 
The eigenvectors are obtained as the following. wah Eigenvalues of B are given by _ 
AS. Be Je r= ah = WO. HS U 
: | = 3 ns =; = 6, A> ifs : 
A,= ye = [4,.93303: x, =[l, 1.41900)": v, = 2 ae (0.57605, 0.81741)" pte 3-A 1 = Az — 6A = 0. Ay =H 
i IIx, | ea 3 3 = 
ce 
____ The matrix D is given by 


Ay = Hz = 0.066966: x = [I, — 0.70472)"; v, = ~2 = (0.81741, - 0.57605)". 


I[x2 |] 








4.90) : 
f TSINCEri ng | fathemetic, 


woh tpl 
D=]0 9 
O 


The cige 
CNVeclors are : 
We obtamed as the following 


A Oy “ 
} “SUL TP ay = = fia ayia 
x, i 
m= O: 82> (ho i]% up = AL ery. 2] 
; | ibs] i 
he matrix Q js given by 
ak 
ea i ft I 
wy | Ott =I 
Note that Q is an orthogonal matrix 
Define the vector Vv, as the following. 
yt i 
1 is am Au, = 1 | : : l 
i = = = 
Hy V6 _ V2U1} V3 
qe [1 
The vectors v., v, are arbitrary, but v 


1: ¥2. ¥y, Should form an orthonormal system. 


l 
Choose Vo. and X45 i 


a 
4 og ld a ead al 


0 i 


Making v,, v3, x, orthogonal, we get the equations a+ h+¢= 


: ia (0 . 
a = b, c = —2b. We obtain a — b= 0. The solution is 


The matrix P is given by 





W3 wv2 wie 
P=[v, vy vy) ={UV3 -vv¥2 wel. 


W3 0 ~26 
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Exercise 3.4 


Verify the Cayley-Hamilton theorem for the matrix A. Find Av" if it exists, where A is as g 


iven in Problems 
J to 6. 

10 -4 re a 1 —2 |! 
1. | O95 4 2.10 2 0 3:\2 3 2 
-4 4 3 1 2? 3 3 | =I 

12 —2 E = 2 lii 

4. /1 1 If. 5 1 3 =11. 6 |i 1 i 

13 =-l -—2 =i 1 iil 


Find all the eigenvalues and the corresponding eigenvectors of the matrices given in Problems 7 to 18. 
Which of the matrices are diagonalizable? 


14 3 ee ee I ee ae 
* bore +. a. 11-1 ol. 6.) = 1 OL 
a1 32 11 O -1 =? 0 1 
La a. wd Oi i 
v0;.) “2 4 St. Hi. | 1 OO i]. 12. |i o il. 
—-] 3 4 -—j —j | ‘fF ¢€ 0 
fo 100 02-2 Oo Toe a 
0010 ii =) ob 3 
. f : 15. b 
as 0001 i =f {ot i it o: 4 
0000 = oe ee a | Et 8 
fg gs 00001 01000 
00010 00100 
a) 1. Abo 
16. oe | 17.)/0 0 1 0 OJ. is: 160 01 05 
cos us 01000 00001) 
¥ 1000 0 10000 


Show that the matrices given in Problems 19 to 24 are diagonalizable. Find the matrix 
is a diagonal matrix. 


3 2 | ~a =e | 0 Zi 
19. }0 2 O}. 20. |-2 #0 4). Zi. |}2 OO 3). 
IL 2 3 -6 -3 3 I =3 0 
ee Cae | | 5 -—6 -6 | 
zz. |] 1 Jj. 23. |-1 4 2}. 


24. |1 





= 
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Find the may 
atriR AU Atoee at Z’ Az is real and 
| 5], If A is asymmetric matrix and x"Ax > 0 for every real vector x # 0, then show that z 


a ed | Lp zy.4d 4 








36 Fy a3 F = Lf 
=), IPenwalwes: 7 7 4 f) = : 
Pa , — Seats 4 SR EPe OTS: ye | th a | We OP. teeth da positive for any complex VOGT SR , the value of 
“6. Eigenvalues: | 2. Dien ey 52. Show that an unitary transformation y = Ax, where A is an unitary matrix preserves the 
& 4 I il i , 3 
27. Eigenvalues sD Ae pagpasae ce inner product. 
. SSR | s ld p + | i | H ‘ . 1 1 1 f 3 
, | ts roperty A’! 
28. Eigenvalues || ea §3. Do the following matrices satisfy propert 
‘ ree ba L Poi i |. | | i | j f 7 i | | i 
=. Eigenvalues i} | | ‘ - -4 | 0 ] 
Pe wae t | I | My fi ,'f | i | 2 l 1 
40. Eigenvalues Lhe Fy ‘ ; (ii) 1 -4 l 0 
4 I a Tay i : f | f 1 i i | F fl i il - 
as Leta a Rw Rais iy em E ‘lig yee 
4 PTA RE eh ryt | epee es i il e ott f 
Matriy R . 4, a" ; = 4 oie a i li sy ] l 0 l —4) 
32.. Let 3.2 aoe 
£. Let g ~S Marin A have eigenvalues 19. | Ein tis se . 
33. : MEMES RSRe OOS teote Bes ay a a 6 ive definite if and only if a>0(1 x | leading 
33. Show th {Toe —_ - i is itive definite j only if a 
i [Nat the matrrees< A and PAP have the SNe Pi penvitues 54. Prove that a real 2 x 2 symmetric matrix | oe 1S posit bY 
34. Let A and B hea «. : 
SBE S4Ure matrices af the “ame order Then, show thar AR erat - . 25 x 2 leading minor). 
SHECNV Gives Aut diferent craenvecy Ts eid Tey minor) and ac — 6 0 (2 B! 
35, _ Lh F 5 er re ‘ j 
Show thar the Matrices A’ B and BA Wave the same errenylaies hat a 21 3 
a | — W bE 
36. ’ TT ot GF “Rt me! ees ek cecal = ’ F * 7 itt 1 a 
An as AMON Ais rreleesgyy i tor sume PUSsitive inlever & AS = Vy SR tat ada Ke 55. Show that the matmx |-3 4 —Il] is positive defimte, 
of a nilpotent Matrix are zere Air =f y 4 
37. 16 Ais an as f dagunalizable migirix and A- = A. then shaw that vac 5 BRN alee atk - | 
: -—3 —2 | 
38. Show that the ima = el : 
- He TTVQITEsS A ~-4 FHL 15 transformed ta - 4tonal matee. -» : a Ht 
hip ne 4diavonal matrix D - Pp 4p where 56. Show that the matrix |—-2 0 4] is not positive definite. 
-6 -3 5 
P is of the form p = |" —sin@ 2h 7 to 61 
i: Cc form and tan 2?@ = — 4 =. . m Problems 57 to 61. 
| sin @ cOs0 | a-h Find the symmetric or the Hermitian matrix A for the quadratic forms given 


39. Let A be similar to B. Then show that (i) A ! js similar ta'B ', (ir) A” ts-simitarts B™ for any 7 = 2x\xz + 4x px, -— xj + Xx}. 


Positive mteeper i, (in) Al= B |. - ; A 
40. Let A and B be ; — 3B. 3x) + 2e,x2 -— 4x,x5.+ 8x20; + 2x}. 
: kb an ~ symmetric matrices of the same order Then, show that AB is symmetric if and 


only if AB = BA 59. x} + 2ixjx, — 8x,x5 + 4ix,x, + 4x2. 


ay Lor any square matrix A, show that A'A js symmetric. 60. xj - (2 + 4i) x,x, - (4 - 6i)xpx, + x3. 
i: he be a ila matrix, ane that A°A ° is symmetric if and only if AT = (4%) be asd ne é EM A 2a 
3. - IS a symmetric matrix and AP = D, then show that P is an ortho wiah use: ‘ | | 
, . | Reduce the quadratic form in Problems 62 and 63 to canonical form usimg Lagrange reduction. 


44. Show that the product of two orthogonal matrices of the Same order is also an orthogonal matrix 





7 
tis ahs - ' fi ma, AY - 63. ve + Ix: + 26x43 + 4x \x3 = 22r57, = 22,7. 
* Find the conditions that a matrix A = |/ Ms ms] 15 orthogonal. ; . reducti 
a aril — Reduce the quadratic form m Problems 64 and 65 to canonical form using orthogonal! reduction. 
3° My Og | e 
‘ 64, xj + 3x3 + 3x5 - 2xpx). 
46. If A is an orthogonal matrix, show thar [AJ = J, ig ~ + a? xix 2rir, + 4x, 
| a + 3x: ~ 4: — 232%, ol 
47. Prove that the eigenvectors of a symmetric matrix corresponding to distinct eigenvalues are orthogonal. 65. 6x; *2 ? ie 
ae a eee a os ae = ne ‘Find the condition numbers 2f the following mairices. 
48. A matrix A is called a normal matrix if AA* = A’ A. Show that the Hermitian, skew-Hermitian and 
unitary matrices are normal. 3 5 ciliate xi oe 
49. Ifa matrix A can be diagonalized using an orthogonal matrix, then show that A is symmetric. | 66. 24 67. 5 4 63.1 0 Ty. = 5+ 64 
50. Suppose that a matrix A is both unitary and Hermitian. Then, show that A = Al, | 3 3 ae 
" + at pid = 
“ #5 Bee 7 
Saat aS ets =o 











a. 
1 1 
7] 
Eg A a 
! ~ 
l i! | . 
ij 
nn | 
a Z ] 
if | 7" st 
| 
3.9 ‘1 | * 
. ‘40TO@ On Voota. co 
€Clor Spaces 
Vie . ‘om i 3 
t hive Curler defined Wo sikh Dc ‘y 
ZETO ver é, de Ee Wh aw Ree 
Vector. Wi ilso like l ites . i] beUTOE SPS pie idee | ecm 
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Sr Bete gk eral a | 


CML 4 ee oe ; 
hat is, space of all KS) 9S} (53 in $5]. Also S=5 


ot (is a - r Tr By 1s ‘ at So ae 
Phe proof 1s SIME fonvarc “aMpspace of | 


Lew x,, y, be two elements in § 


1 and xs, ¥, be wo clement 
on _ a ¥y $ 1n §, 
V such that x = *, +X, and y — 


Chen, ther a are a : 
=e © are elements x and yan 


Now. ' | 
1 a | = A EE Rilte egy ED ws 


is an element of S, since (x, 4 VIE 3, and (x. + ype ¢ 


Also, _ 


is an element of §, since @x, € 5, and ax, S>. Therefore, § = ‘| + 55 iS a subspace of V 
Two simple examples are the following. 
QJ Let $, = ((x, 0) |e R} and S5= (0. lye &) be in R°. Then, S++ 5,0 Rt. 
(a) Let 5; be the x-axis and Sy be the y-axis in. Then, 5) + 55 is x-y plane in RY 


PS). S5, “a e ire subspaces of V. then 3,458,404 § = {S| +S) +... +5,), where a 
UW subspace of V. 


Theorem 3.18 If 5}. 5; are subspaces of a vector space V, then 
dim(S, + 5) = dim(S,) + dim(S5) — dim (5, $3), (3.72) 


Proof Letx={x,, X2y +--+ Xp} be a basis of S$; 7 S,. Since, (3, 7 S,) ¢ 5,, x can be extended to a basis 
(Xj. Xge---s Nov Yi+ ¥o.---. ¥,} Of S,. Similarly, x can be extended to a basis (Xp. Mpyeeee Mgr Zyy Zpue--eZeh 
of $5. Therefore, the set of vectors 


a Hs 


a ae 
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le 


{jp Xgo soy Kyo Vyr Vow nee Ngo Zys Zgoeery Zod (3.73) 


pace $= 5, + S,. We shall show that the set of p + g + r vectors (3.73) is linearly 
tor s 


spans we If they are not independent, then 
‘ . - -_— 
. OX +... + &X, + By; + Poy, + ...+ By, + 2, + ht t+. ++ YZ, = 9. 
phi (3.74) 
a O6Xz + +» + OpXp + By, + By2 +--+ By, =— (N21 + B22 + --- + HZ) 
+ OyX2 t+ : 


. = — “Ty i 
calars Q;, Bj» ¥- The left hand side is an element of S, and the right hand side is an elemen 
scalars (4), Pie fir 


for some both of them must belong to 5, ™ 53. Hence, 


of S,- Therefore. 
Viz) + FZ, + ... + ¥2,= O,X, + 55X3 + ... + OX, 


i t, i that 
me scalars 6,. Since the vectors X;, Xp, «Xp: Zj- Zzy--.2, are linearly independent, it follows 
50 


Fe 0, = 0 forall i. From (3.74), we get 
GX, + ODX2 +... + &X, + Bry, + ByY2 +... + BaYq = 0. 


ince the vectors X), X, Xq- Vy» ¥2- --» Yq are also linearly independent, it follows that pm 0, is 
1 ince : bi a ae Fe i : -s 
= sara ji. Therefore, the set of vectors [X,, Xz,---:Mp, Vy, Y2r---:Ygr Z1+ Zze---»Z,) forms a basts o F 


+ 5. ; 
We.obtain dim($; +5) =p+qt+r=(p+qg)+(P+n-p 


= dim (§,) + dim(4,) — dim(5, ™ 53). 


3.9.2 Direct Sum of Subspaces | 
Theorem 3.19 A vector space V is called the direct sum of its subspaces S, and S;, if and only if 
(i) V= S, + S,, and (ii) S$, % S, = {0}. The direct sum is denoted by V = S, ® Sp. 

Proof | 

(i) By definition 5, + S, = {s, + 8,18, € S,, 8, € S}. Therefore, every vector in V can be expressed 
in the form s, + 5, if and only if V = S, + S. : 

(ii) Since 5, and S, are subspaces of V, 0 € S, and 0 €S>, that is 0 ES, A Sp. Let, there exist an 

arbitrary vector x such that x € 5; M S>. Then, x € 5, and x €S,. We can write the vector x in 
two ways asx=x+0=0+x,asxeS,,0eS,, and 0€S,, x €S,. By (i). there is exactly one 
way to write x as the sum of a vector in 5, and a vector in 53. Hence, x = 0 and 0 = x. Since x 
is arbitrary, we get 5, 7 S> = {0}. 
Now, let 5; a S, = {0}. Lets, « S,. 8; €S,, and S, € 5;, Sz € Sp. Suppose that we can 
write an arbitrary vector x in V as x = s, + s, and x = s) + 55. Therefore, s, + s; = s, + 
8, OF S, — S; = 8} — >. But, s, ES. s| € S,, and S, € 52, 8> €S;. That is, (s, — sj) €S, and 
(82 — 8) €S, Therefore, s; - s} = S2 — S; ES; 7 S, Since, S; A Sy = {0}, we gel s, = s| 
and s, = 55, Therefore, each vector x in V can be uniquely written as xX = s, + s,, where s, € S, and 
5 € §). 
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; ime iGill WIE aan Thus R? = S$, + S,. Now, we shall show th | 

eal xamatrices A, Let $, be the cubspace of all syininetr; | ' , ! : 2 ca at the subspaces 5,, 5, are independent. That is, no non- 
zero vector from S, or 5, can be written as a linear combination of vectors from the other subspaces. 


| Fie : mS) We ihe subspace of all skew -SYINMCiC that ics 
matrices B, = [{A, + (A,) }/2] of order mn, anu a, De TN Suppose that the subspaces are dependent. Then, we can write. 


i . Pa aE : 
C,=[lA;- (A,)")/2) of order n. Then, Vs the direct sum of 5, and S>, that Is V=S, @ dp. 
0 1 


For example, let V be a vector space of 


Remark 3.31 


When a vector spa 


ce Vis the direct sum of its subspaces 5, and §,. then . a\-1|+b|1|=c|3|, ora=c,-a+b=3¢,0+2b=0. 
l 2 j 


and basis (4)) + basis (53) = basis |W). 


dim(S,) + dim(S.) = dim(V). 
The solution of this system is a= b=c =0, We conclude that the subspaces S,, S, are independent, 


that is 5; 0 52 = {0}. Therefore, R’ = S, @ S,. 





Remark 3.32 
The vector space V is called the direct sum of its subspaces S), 5p, ---+ Sp if and only if | 
: | Example 3.49 Let V=R*, and 
(1) V=5,+5,+...+5, and an. [ E5; ]= 1 1= 1,2, peg (3.74) | 
j*s e l 0 (! 1 
It is writen as V= 5S, @S,®... @ S, Further, 2 1 |} 7 
5, = span . 5, = span :| . |p and 5S, = span 4 
r Fr oF 3 —| I F 8 
dim(V)-= ¥ dim (S), and basis (V) = > basis (§,). (3.77) | 3] 9 }\8)] 3 
i=l i=] ' 
iaiaaaiake Show that V= 5S, ® S; @ S;, Ls. 
A collection of subspaces {S,, 5,,....5,} is independent if no non-zero vector from any S. can be written Solution It is easy to verify that the vectors x = (1, 2, 3,-i),¥ = 10, 1,-1 Hoe 5 1h 8)’, 
as a linear combination of vectors from the other subspaces S,, Sy. ---. 5j_1» Sis ---S- w =(l,-7, 8, 3]', are linearly independent (det{x, y, 2, w] #0), and hence form a basis for R’. Every 
Remark 3.34 vector in R* can be uniquely written as 
A vector space V is the direct sum of its subspaces S,, Sy...5, if V= 5, +5, + ...+ 5, and the subspaces : 0 1\ l 
S,, 5,...5, are independent. , i 
| 2) b | +5|_. | =s,+5+5E5t St! 
| Example 3.48 Let V=R°, and a) {+} F] ity ls 1 HS tH ES, + St Sy 
-] 2 g 3 
1 \/0 1 
5, = span 4| —1|,| 1 |, and 5, = span<| 3 | >. Taus, RA =S; +S, +Sy: Now, we shall show that the subspaces S,. Sa, Sy are independent, IS 1 
: 2 1 | non-zero vector from any S, can be written as a linear combination of vectors from the other subspaces. 
Show that V = S, @ S,. sar vose thatthe subspaces are dependent. Let us try to express the vector in Sy in ems ofS YSN 
Solution it is easy to verify that the vectors x = [1, ~1 1]’, y = (0, 1, 2”, z= — in S, and S,, Then, we can Wale 
independent (det[x, y, z] # 0) and hen fi * : ; ,y= aoa z= [, 4, 1] are linearly - P 
Te SE pa ] # 0), ce form a basis for R°. Every vector in R° can be uniquely , 0 1) ; 
7 | 7 | 2 1 _|-7 
Z cok : 1 0 14 | | al ttl _alt alin} s | . 
Ocoee Ee an a} —-1}+ Bl1||+y||3|| =s, +s, €S, +S, . | 4) 4 (2,8 3 
] 2 1 ; : 
; See it “. = 3d. m is inconsistent 
pie | tiriggacad weuese=- 1 Sa-b+e“™ avahene ca we find thal 
‘ « pac=d=0. Hence, Sy (S; + 5:)= (0). ys ; 
and the solution of the system 18 @~ | . 
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S, (8, + 8.) = {0}. The vectors ind, cannot be written im terms of weelors in 3) OS We cere Lute 


that the subspaces S,, §>, $; are independent. Therefore, V = 5, PS, 8 4, 


3.9.3 Complementary Subspaces 
and S,, that is B= 3) oe Yo. Chen 8) cmd 4 


Hf the vector space Vis the direct sum of its subspaces 3, 


are called complementary subspaces of each other. We note that a vector space can have more than Orne: 
a subspace may not be umieyue 


pair of complementary subspaces, that 1s, a complement of 


Consider the following examples 


4 4 2 
(i) In A*: (a) x-axis and y-axis are complementary subspaces. (b) Any pair of straeht lines three 
ee = a} 
ongin are also complementary subspaces 
(ii) In AO: (a) x-axis, y-axis and z-axis are Complementary subspaces (b) The complement of yaxie 
is yz-plane, or the complement of vz-plane is x-axis. (¢) The complement of 2-aats ts ty plane. op 
the complement of xv-plane is 2-aars. (d) Any line through the origin and any plane Contuinine 


the ongin but not contamning the above line are complementary subspaces. 


(iii) The space of all real 2 = 2 matrices can be written as a direct sum as 


* by {a le foe) A Ife ale | 
(ce a}f~ |lo 0) ~ Tho ol] | be of | 


= 5, @S, 8S, 8 Sy, 


The subspaces S5,, 5,, 5; and S, are complementary to each other. 


Theorem 3.20 Every subspace of a vector space V has a complement. 
Proof Let S$, be a subspace of V and let B, be a basis of 5,. Extend this basis 8, to a basis B of V. 
Define the subspace S, as $; = span (8 — B,). Let x € S,, that is x is a linear combination of vectors from 
B,, and Jet y = §;, that is y is a linear combination of vectors from (8 — B,). Suppose that 0 = x + y. 
Since # is linearly independent, we obtain x = y = 0. Therefore, 5, + $5 is direct and 8, 4 S$, = (0). 
Since B, U B generates V, we get V= S, ® S,. Hence, S, is a complement of 5}- 


Example 3.50 Consider the vector space V = R? mmf 
complement of S. P . Let S= {(x, y, z) 1x + y+ z= 0). Determine the 
ae It is easy to verify that the vectors x = [1, -2, 1]", y =[1, 0, -1]’ form a basis to S, that is, 
id a ~ es — the basis B, to a basis of R°. Consider the standard basis of R*, that is {@,, &2, €3). 
seach a “as of the basis B, as B = [x, y, e,}. If it is not a basis, then e, is a linear 
Reality decease af ai irs exist non-zero scalars a and B such that ox + fy = e,. Comparing 
hence e, is not a linear shi ; ia = 0, and aaa B= 0. The system of equations is inconsistent, and 
B is dim(R*) = 3, We find co fe and y. We conclude that B = {x, y, e,} is a basis. The size of 
and e,. Therefore, B is a basis ae R ei + €, and e; = —y + e, are linear combinations of x, y 
rebar . =. e complementary subspace of 5 is given by 


* i 
7 . a 
i 


_ -«*S =span(B-B,) = {e;} = ((7, 0, 0)), where ne R. 
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Matrices 


ntary subspaces. | one: 

asis B, as B = {x. y. e,}- If it is not a basis, then e, 154 ae 
: | e€ 
d B such that ox + Py = &- Comparing 

ah no nsistent, and hence 


m of equations 1s inco 7 
= {x, y, €2} is a basis. The size of Bis 


linear combinations of X, 


We may also obtain other compleme 
Now, consider the extension of the b 
Then, there exists sc 
—~2a= 1, and a— B=0. The syste 
conclude that B 
= [(x — y)/2] + & are 
mentary subspace of S$ is given by 


combination of x and y. 


elements, we get & + Bp=0, 

e, is nota linear combination of x and y. We 

dim(R°) = 3- We find that e, = [(x + y)/2] + e>, and e; 

y and €>. Therefore, B is a basis of V= R°. The comple 
5 = span(B — B,) = (e2) = (©, 7, 9)). where 7) € RK. 

Similarly, we can show that B = (x, y, €3) is a basis of V = R’. In this case, the complementary 


subspace of S is given by ; 
S = span(B — B,) = (es) = (0, 0, m)}. where WER. 


This verifies the remark that a complement of a subspace may not be unique. 
3.9.4 Inner Product Spaces and Gram-Schmidt Orthogonalization Process 
Consider a real vector space V. An inner product denoted by (,) on V satisfies the following 
properties: 
(i) (ax + By, z) = a (x, z) + BY, 2)- 
(ii) <z, ax + By) = a (@, x) + BG. y). 
(iit) {x, y) Ss Cy, X). 4 


(iv) (x, x) =Ilxil? 20, x #0. (x, x) = 0, if and only if x = 0. 
An inner product space is a real or a complex space together with a specified inner product on the 


space. 
The following are some inner product spaces. 


(i) Consider R", Let u = (x), X2, --» X,) and W = (, Yar ---1 Yn). The standard inner product on R° is 


defined by (u, w) = Va 
i=! 


(ii) Let the vector space be V = C [a, 5]. Then, the inner product of two functions f and g is defined 


b 
by (f.8)= | f(z)gde. 
We shall consider only the real inner product spaces and the standard inner product. 


Remark 3.35 

Every orthogonal set of vectors {X,, Xp, ..-. X,} in an inner product space 1s linearly independent. If they 

are not linearly independent, then for some a, # 0, a,X, + a2X + ... + a,x, = 0. Taking the inner product 
the orthogonal property, that is, (x; x) = 0, /#/ 


on both sides with x,, X2, -... X, successively and using ( 
and <x,, x,) > 0, for all i, we get a; = 0 for all i. Hence, the given orthogonal set of vectors is linearly 


independent. 





ss | ae Oia a 








(a set of lin | 
always possible to derive an carly independent vectors) 


; In an inner Product 

Orthono l hac: et a 
orthogonalization ‘ich rmal basis to the inner product space by using the Gy, 
Theorem 3.21 Let & 


, — {x,, X35... 5X be an 7 . i 
Exists an orthonormal] basis Y = ty, . arbitrary basis to an inner 


Product space y 
a lower triangular matrix. 


Th there 
-»Y,} Of V. The translation matrix T from X to YX a ; 
estas i | | 


Mm=X, y,=u,/iuyll, 


M3 = %3)U, + Bot) +X3, Ys = u,/I u, ll, 


* + f2Us + f,3U4 + 0 + Veta 2 ju, _ 1 + X,» Sas = u,/ lu, t, 


“+ @ are mutually orthogonal. 


where fi; $ are scalars to be determined such 


Requiring u, to be orthogonal to n,, 


we get 


(Uz, Uy) = fay (uy, u,) + (x2, u,) = 0, ty) =- (2, uy) 


——= 


(uy, u,) 


(X2, u,) {X>, Uy) u) 
ay 2 ha ag = 22 - > ¥1) »:- 





¥2 = U, / Ilu,ll. Hence, y,, y> are orthonormal vectors. 
Requiring wu, to be orthogonal to u | and u,, we get 


{u;, 0,) =n, (u U,) + f52 (Us, U,) + (x Oe i ea 
ye 4] ye ™y a2 ar *) ar : i (uy, u,) 


(X3, u>) 
(U3, U2) = f5) (uy, Uy) + f32(a, Uy) + (x3, U2) = 0, 4.) =—- 











(Uy, us) 
(X3, u;) (X3, u,) (X4s u,) (X;3, U>) 
1, =X;-— > 8) - ——— U, = x; - ——— uy, - —— u, 
i Te Ga. Gg ut? uIP 
‘X2,U,) u X,,U,) u 
= %;- Ms — — ath —— = X3 — (X3, YY; — (Xa. YD¥> 
Hut thuyll Hust iui 


y; = u;/iluil. Hence, y,, ¥>, Y3; are orthonormal vectors. 
We prove the result by induction. Repeating the above procedure, we get 
u,-1 = aA-1 (x =|? YY; — Myads Y¥2)¥2 ~ o (x -il ¥n—2) ¥n—2- 


~ Yn = U,_)/llu,_j ll, where y,, y>, .... ¥,—) are orthonormal vectors. 
Requiring w, to be orthogonal to U,,_;> U,_2, --, U, and simplifying, we get 


SPace, it js 
am-Schmid; 


=O), 
i 5, = {(a, b, cla + b + 2 | 
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= Xp — Ka Yaa — Kye VD? — 0 — Sn Ya n= 
om u,/ liu, |. - - | 
asain vectors. The set of orthonormal vectors y = {¥\. You om Ye 
are 0 


Sy Se trix of transformation is lower 
oy Vn of construction implies that the matrix 0 
pence Yu my The procedure 
— basis for 
ae a idt orthogonalization procedure, obtain reer a 
8 .¢ the Gram-Schmidt 0 Ty =(3,0,2)'.x;=(2,-2,2)- 
ni 51 Using the enendent vectors X, = (2, 2,0), x» wane peg 
example 3 Kok linearly indepe oy the sive Gectore ate linearly independen rz ee — 
of toe ance det (ay 2X3) # OF Fw th 2, OF 1S pI 6% 
golutio® sine uy = ee Be (3 0, 2 =< (6/8)(2, 2, 0) = 


vp, = X,— Op Wi 


7 
T - Eas : 
U2 2 (3 -2.2| xy, 9) = 9 (xs, 92) = 10 iB 


y2 * hu, MEP LE 2 


— (5, ¥2 
u; = %3 (X3, yy (X3 ¥2) ‘ 

j T 
, = (3 } =——_—— (4, —4, —6) > 


= (2,-2.2 —Fa\9" 2") 1 
@ 17 
Tt 
“a 17 2» aaa pe Oe 
%5*jia,l 2 il 
_ th onormal basis for R° 


The set (¥1» Yo Ys) _— 
Exercise 3.5 
1. in R’, the subspaces St Sa 5s 


5, = {(a, b, la = Ph 


- 2 = 4 4¢ = a, b,c € R- 
{(a, b c)la 2c = 0,5 4c = 0}, 
5,= a, 


a3sy 

Determine 5, 7 Sy 7 Sy and Sa : 

a -yt 

2. Let Sy = (C4 y» 212 ed yix-¥ 
Find a basis for 5) 92 7 = 0}, 522 1 


| ie 2 .¢. de R}- 
In problems 4 to 6, test ((0, , 4) + © 
: d, } 
4. S, = ((a, 6,9: 
5. 5, = Ua, b, 0): 4 
6. S, = ((a, 0, b)+% 


7. Test whether R= “1, g, = span {((l.—> 
5, = span{(1. 2+ 3-4) +" 
i 


4 
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ipeqerandptqtrel: 


In Problems 
. the c | 
a 5) = (Gy, Dl2x~y 4 ae tary subspaces of S, in R’- (i) 3, 
Using the G aivice z=0}. 95, = {Ge y¥, Dixt+y+7z=0O). (ii) 2. tpequrandptgtr=0, 
linearly inde orthogonalization procedur AD en See 
independent vectors given in obtain an orthonormal basis for R° for the set 'y (iii) 2, if exactly two of p. g and r are identical: 
10. x, = (1,-1. 9)7 problems 10 to 13. of awed. tp ag = @ 
»—4, OY. =, 1,-1)’, x; = (0, 2, 1)". , —— 3 ; 
30. (a) 2; (b) JA] = (4,42 * bb, + €yc2). tank (A) 1s 
(i) 4, if aja, + 5,5, * €1e2 * 0: 
| determmants of third order have the value zero. 


1 —- 
sae : 1)’, x) = (1. -1, 1)7, x, = 2, -4, -2)7 
page -~1Y, = C1, 0-177, x, = G, 1, 37 
Shins Setndatictagta eta eas 
14. amiLaw ee 14 to 15. —ae 
pe i eng -¥;=(1, 1.1, 1)", x, = (4, 4, 1, 1)". x, = (1, 0, 0, 1”. 
, 0, 1)’, x, = (1, 0, 1, 2. x, = (0,2,2, 1). x, = 0, 0,2, D7. 


33. (1) 


3.10 Answers and Hints 





(ii) 2, if aya, + 6,52 + C12 = %- since al 


32. Consider (1 + A) (I-A * A 
A™ —> 0. Therefore, (I + A) ( 


Gi) Trace (AB) = 55, Gaby = SD bina: = Trace (BA). 


(iit) Hf the result is true, then Trace (AB - BA) = Trace (I) 


- iy ay} =F + (-1)"'A*. In the Hmit x =. 


ei Ae = a Ee 


= @ 
Trace (2A + BB) = a>.a, + BY bs= & Trace (A) * B Trace (B). 
re | 


=I 


r=| i= i=l ai 


which gives 0 = 2 which is not possible. : 
Let it be tue for p = k and show that it is ruc for p= & + 1. Nowe 


have CB” | = B'*' C and CBC = @ 


Exervise 3.1 
322 : 
I as 
” At=< 2-3 2] = I a = 34. Result is true for p = 0 and |. 
f 2 =wZ satin eat | 2 =i =H that when BC = CB and C = 0, we 
RG) tag i> 3 -1 Ye Apaly thamenees Ce G+ Gtx. = Canin Seeger Bye By Ket = Se ™ 
Gi) eo ee ee eee 36. None. 37. Symmetric. 38. Skew-symmetic 
= (A). Simce BO = adj . 39. Hemniti , i 41. Skew-Hermitien. 
, adj (BABI, - — - Hermitian. 49. None. = t3 
0G (A) adj (ad A)) = adj (AT = tar? 1 we Rate Bad 8) BE. Thacetow, 42. None. 43. Skew-Hermitien. 44. Hermie - 
aplying by A and using adj (A) = A~* 
-i z= =A™~ IAL we eet 45. None. 
AUA 149) ad (adj (A)) = AP” AI oF adj (adj (A)) = 1A A. ~ 
Exercise 3.2 
1. Yes. 2. No, I, 4. 5. 6. 3. No, 1, 4, 5, 6-. 
satisfied. If the field of scalars 1s taken 


9. IAA“) = ABA“) = © oe LAY = HI 
13. AB= BA — B’AB=A = B'A=aB* 

sa A= . Simileriv. A“B = RA- 

@ (AB *y = By a’ = By a’ - BAH ee B=BA™. 


4. 


= 


Ga) (A“BY = Bay = B’ (a7y* = Bata tp 

e aay =(@ay"y = MABy'Y = 0477? By = ate 
- Pre-condiply botk siies by ) I — A, Gi) T+ A. : 
(PAQ;* = QAP? =I =A4"P*=Q 547 = OP : 
= Use (I-A) (1+A+A7+_j=I : 
7. (ABC) (ABC; = Pre-oanitipiy Saccessively } 
—— L : by A” BO and 10. 
ie 19. Lit ; ee : * 11. 

22.) £42 and k 2-3, Gi) k=2 of k= -3 

: 12. 


= 6= £6, oc = sm [(9 — 461 ys] 
25. GAx3. pg wberwy, G) 1-3 y- : 

as 2 27. 1. aoe cag. 
9. IAS= (ah gr — Ph Mp + 9 + ry, sank (A) is 





No, when the scalar q is irrational, Property 6 is not 
only as rationals, then it defines & veactor space. 


| =x — x, the zero vector @ is 1 = I. Define 
©. Therefore. negative vector ts its reciprocal. 


7. No, 2 3. 3 10. 
B)x = x78 = x* x? = x* +3? = ox + Br. 


Yes, since 1 + x= lx =x=xandx+I=« 
_y = I/x. Then, x + (— 3) = x(x) = 1 = 1= 


No, 8, 10. 
Yes (same arguments as in Problem 5). (a * 
(i) Yes, (ii) No, |, 6. 
(i) Yes, (ii) No, 1, 4, 6 
(i) Ves. (ii) No, when x, ¥ € Wirtye FF, 
(iii) No, when x, ye Wi x+y e FM, (iv) Yes. 
(i) No. when Ae W.aA€ W for @ negative, 
(ii¥*No, sum of two non-singular matrices need not be non-singular, 
(iii) Yes. ; 
gto W (A =1LA°=1= A but 2A # (2A)°)- 


(iv) No, aA and A + B need not belon 
(ii) No; let @ = i, Then, @A = 1A € Ww 


. (i) Yes, 
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i: 4) RE: MEePoOe HP 


(tn) No, for FP, Oe | 


pias 


Iv) So, for P. i) & 


F 1 fa] yr 
ee ae O = ug? 4 os 
15. (i) Ves, 
(ar) WN -¢E 
Bi Rye Boe bp Borer example, if ma = (x). my. a) -— Dhow = 4 ' I 
a. i}, 
eee RF eae + pcan ye Tye 
(im) No, ze , ay 2 Wy tor @ negative, 
(iv) No, iv) f 
rte Ware W. (v) No. xe Wlaxe W, (for @a rational number} 
16. (i) w+ 2y Ww, (ujzu + ¥— w 
Car) (—3 3m — Iw + 23wi'le 
7. (i) ou = By l 
dy + 2w, (uj3u+yv— Ww, (itt) NOt possible 
ia. ()) -3P ary = 2Px(t) — P3(t) (mn) SPC) - Petr) + SP .C8). 
19. Ler 5S = ‘} 
10, ¥, wi} Then. 5 = (a. 6b, oc)’ = au + By w : 
A ¢ - ; wh =ja-+ “ — ja 
= ae B ¥ cere @& (a + 62, 8 = (a - py 


20. Let S= (A, B,C, D), Then. Ek = ' 


t 


i) 
_ 
WwW, ore 


| 7 te = 5 
I having real roots, P + (/ need not have real roots 





= i, (i) Yes 


Wand also P+ Oe W, 


et ae 


5 
r = @A + BB+ yC + 5D, where a = (- a — b ~ 2¢- 2a)/3, 


P= (Sa + 2b — 4c + 4dy3, y= (- 40 ~ b+ 5c = 2/3 and $= (- 2a + +e — wd 
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(iv) a2 x 2 skew-Hermitian matrix (diagonal elements are © OF pure unaginary) 1s given by 
ia, b,+ib2\) _( 9 Ai 7 "2 


i —b, +ibz ia “bh, 9) pe 


=B+ ic 


re ee skew-symmetric and C is a symmetnc matnx, 


0 1\f1 0\(0 1\(0 9 
dimension: 4, basis: _1 oflo of lu oflo 1 ' 
o 1\ fo o\/! oO 
(v) dimension: 3, basis: o of li of lo -1) : c 


1 -1\ (0 0) (0 0)| 

(vi) dimension: 3, basts: e of li of lo : J | 

29. (i) dimension: 3, basis: {E,,, E22. E;;}. 
(11) dimension: 6, basis: {E,)> E,3; Ey; E33, E33, E43}. 
(iii)dimension: 6, basis: {E,,, E>), E, E3;, E32, Es}: 
where E_, is the standard basis of order 3. 

30. (i) nr’, (ii) 7, (iii) n(m + 19/2, 

31. Not linear, T(x) + T(y) # T(x + y). 32. Linear. 


(iv) n(n — 1)/2. 


.. 


ae | 2 33. Not linear, 7(x) + T(y) # T(x + y). 
21. (i) independent, (11) dependent, (in) dependent, a ) ‘ ' 
(iv) independent, (¥) dependent, 34, Not linear, 7T(1, 0) = 3, 7(0, 1) = 2, TU, 1) = 0 # TQ, 0) + TO, 1). 
22. () Independent, (11) dependent, (111) dependent, 35. Not linear, 7(x) + T{y) # T(x * y). 
(1v) independent, (v) independent, 36. ker(T) = (0, 0, 0)’, ran(T) = x(1, 0, 1)? + y(1, 0, -1)7 + 2(0, 1, 0)’. 
Z . - ‘ = 7 7 x 
‘ 2 4, = (1, 2..5) + 2(-1, 9-4) (3, 1, 2). The vectors in § are linearly dependent. dim (ker (T)) = 0, dim(ran(T)) = 3. 
25. +r+1=[-re+ 


(f° = 1) + 2¢r + 24 + 2))/3. The elements in § are linearly independent. 
<6. (i) dimension: 2, a basis : {(1, 0, 0, — 1), (0, 1, - 1, 0)}, 


ii) dimensi 38. ker(T) = w(1, -2, 0, 1)’, 

(11) dimension: 3, a basis: {(1, 0, 0, 1), (0. 1, 0, I), (0, 0, 1, 1D}, ran(T) = x(1, 0, 0)" + y(1, 0, 1)7 + 260, 1, 0)? + w(1, 0, 2)7 
a basis: {(1, 0, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1}, | = r(1, 0, 0)" + s(1, 0, 1)” + z(0, 1, 0)’, 

(iv) dimension: 1, a basis: {(1, 1, 1, 1)}. (1, , 


27. The given vectors must be linearly independent. 
(i) #0, 1 - 42, (ii) k #0. 


37. ker (T) = (0, 0)", ran(T) = x(2, — 1, 3)’ + y(l, 1, 4)’. dim(ker (T)) = 0, dim(ran(T)) = 2. 


(ti1)dimension: 3 


where r=x-w, s = y + 2w. dim(ker(T)) = 1, dim(ran(T)) = 3. 





(iii) k# 0 (iv) k#—-8 39, ker (T) = x(- 3, 1}', ran(T) = real number. dim(ker(T)) = 1, dim(ran(T)) =1. 
1 + 1 — a. | 
28. (i) dimension: 4, basis: {E,,. E,. Ex, E,,} where E,, is the standard basis of order 2, 40. ker(T) = x(1, -3, 0)? + 2(0, 0, 1)’, ran(T) = real number. dim(ker(T)) = 2, 
eo (t 0) (0 1 0 0} dim(ran(T)) = 1. 
2 ! l?. T : - T T re. eg 
0 O/ \1 OJ lo 1) 41. ker(T) = x(l, 1)’, ran(T) = xQ1, 1° - vy, TY = rl, TY, where r = x — ¥. 
dim(ker(T)) = 1, dim(ran{T)) = }. 
o! : T : r ny? + =(0, 1)" T) = r(-] oy! + 
—1 0)" 42. ker(T) = x(1, 2, -3)", ran(T) = x@, 3)" + y(-1, 0)" + 2(0, 1) oF ran(T) , 


s(0, 1), where r = y + 2x, $ = 2 + 3x, dim(ker(7)) = 1, dim(ran(T)) = 2. 














Fug 9 
47. ‘We have 7 fv, v.) = fw, ws wij a=) 1-1 
Le 4 
Now any 
ix] eT 3} 
= = t 
72i 0 it] Pla] 


4] 
Tx= aTv, + BTv,~ al2|+p 
0} 


48. fx =} —%, + 22, +8, | 


Dx. 
sid; * irs + iZr; | 
i a 


_ 





— 


tah 


nf 2) [4 
12 3/=/2 
bal ls 


¥ WEStOr X= (2, =.) im IR? with respect to the given basis can be written as 


‘om hl 


)2. Hence. we have 


bs 4a+5f j— 6x, + 7x, 
[|= ]2a+38 =5 «Rie gies 
i! B 24, — 35 


49. TPs) = (4x, - Sx,) + T(x, - x,)¢ + (2x, -— x)e?. 


50. “) Two degrees of freedom. dimension is 2. 2 basis is ({3. 1, O}, [-2, O, 1p}. 
{ti) Ome degree of freedom. dimension is i. a basis is {(-5, 4, 23)}. 


Exercise 3.3 

no? z. 

5. 2. 6. 

a. 19. 
13. 2. 14. 
16. independent. 3. 17. 
19. independent, 7. 26. 
22. Dependent, 2. 23. 
25. Dependent, 7. 26. 
27.{! + a - 2a. of. o arbitrary 28. 
29. {1, 3, i} 1. 


33. (5 + a — 46/3. (1 + 2a + B35, « Bi. a. B atoitrary 


Z 
2. 

z: 

rs 
independent, 3. 
Dependent, 2 
Dependent. 2. 
{J. 2, 2] 

(3, 3, 3] 


3. 3. 4. 
a. 2. 8 3. 
it. 2. 12. 3. 
15. 2. 


18. Dependent, 3. 
21. Dependent, 3. 
1A. independent, 4. 


bh 


34. (3/2, 3/2, 1) 32. [-1, -1/2, 3/4]. 


ee gb 
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44.{2 - @ 1, @ 3). @ arburary 35, f-14, 4, ba, ay 


36. { - @ @ al. o@ arbetrary. 


38. (0, 0, 0). 

40. (2 (P - av3. - OB * ay3. B aj. a B arbetary. 
41. [0. 0. 0, 0}. 

42. (28 - Says. - (108 + a4. 8, al. a B arbitrary. 
43. [(a > S5BW3, (48 - Fav3, B. al. a B arbitrary 


37. }- 1 San, iS. ah. @ arbirary. 
9. [-lal3, Ja}. - Bed, ao). a eberary 





44. (38 -— Says, (36 - 4ay3, B al. 2 B arbitrary. 
45. [a — 36. 58 B a) a, B arbitrary. 
- f-) § 3 i 
a Sides — Pe) ae b 4 
46. 1 =—3 2 47. =? a at Z| ' ee if 
= 2 =I 1 —2Z 3| ' ‘4 al 
[ =| -1 -! -| -3 WwW i 
| | 0 0 -1| 
1390 + 0 1 = 
711 0 0-1 — yy 6 8 
io Oo | | 1 iG -W3 a) 
Exercise 3.4 
j ot 16 20] 


. 1 ; 
1 PUY = 2 - 98% -944+81~0;A'= —| 16 1 4S) 


6 —4 -2] 

| wal ; 

2. P(Ay= 2-827 +200-16=0,A'=—| O 8 4 
7 =a 


3. P(Ay = B- 38 + 2A = 0, Inverse does not exist. 


[4 4 -4] 


4. pay B-2- ads 4 AT = 21-2 = 
[-2 1 | 
2-3 -7| 
i 
} ae = | = “ls a! | 5 3 . 
5, PAY= 2 - 5k 7 W-LEDA ~ 


oe ee eee 
ae : 


— 


jé Aaya? - Fst ae Rs mG 
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LUN sie 
Peer rn Miarhe PPM tdEny 
to uy 7 | 
‘ | | 1 | A fee Pe Wy int obey cmalicable 5 4 
, Sa he By dig 4 il ae ee! Be | rt tl 1 fp. divvzanteeath 322 a ia 
ae a a a i ony: P=|-1 0 1|:p"'=| 3 -6 -5 
io 3 “ mL dwenhieable 7 . 
ii. | | | a I | 4 (oy 4)" nol diaconabia able a a ; 
A t ly 1), | | | ‘ee Ll. ik | | 24. A=] fl. - l= 1}; a= 2: [0, iL. isA=-2: [8 — 5, ae 
i vit ft wi 1) ‘)o. diaponalwable 
I2. A Be EM DP pth Bette A fio, 1p. diayenalicable “7 oO: #& 2 & —6b 
Is. 4 moo ad PO OS et divarendivalile P=|-I | —5 . po! aa 15 -3 
I4. A OU Yd. otk ony | | tobe A ' 14 0, TY -i | 7 2 Oo -! I 
A ft [ee od Mo. daawomulizable 
Is. A i. I. ‘a | NB i. tk Bl 
: : ! otk OP [Vy ade oy gy", Ce 0; | oi 4 0 + 6 32) 
| I, Tg i | | diavoanwhvable 0) 0 po! -. | \ ”) | 7 PDP~' 
1G. A mE se No, “Ss a = EE a A ae ESL , = " ase “i = 
A = a Ga WP v2), I 2 1, bp. diagenatizable 0 _ : oak La 2 
7. A Bo Eps. tia 0 i do ate = ee Be TG FO, Vg | 
MO. O20, OOP", diapaanltzuble I i 3 -1 2 I 6 -5 -7 
Ma, A gi, SE HT, fitth reat of uniny Let os ae ae ie 26. P=|1 0 1 -pol=|—| 1 2 -A=PpPr* = 1 M £1, 
A Ser bike Ge EPS on (ood, 2.9, 4, diavenalizable 0 | J 1 —| —! 3 -3 -4 
if. A oe oe dy pea Bea ee de fds Oh 1)’ 
i + 4) ryt . 12 |] —-l)l 14 =-5] 4 -12 46 
P=/| 0 | al pPis=tig 2 0 27, P=|2. 3 4|P'=— 14 -8 2 |, A=PDP'=—— 2 i 34), 
| - | iu L | “| 7 1 1 4 9 =) 2 l }— 34 4 38 
a = [= ay Oa 1 (+ 2S es ED SB i 
, feb be B “ey fo 22 100 
+ # 24) [-s a) 28, P=| 1 -1 I;P=2|2 0 2|,A=PDP™'=|0 1 OJ. 
P= 2 23 sete 2 | “i l | =-1 z 2 0 0 0 1 
1 Oo 2 1 “fat =2 4] 
a i J 7 % ; = mf l l =A = | 
2h A [Sp hee) h Ale ae si, eo ow af A egy (3-7, | - 3, 4" = ie : a Eee Ue 
29. P=; | O 1j|;P =3 1 1 -—2|,A4=PDP — ae lI. 
3 3+i 3-i ih 24 «= -8 «16 0-1 | tC 22 -1 
P=| 1 143i PP 3 2i-6 2-6 -8 
32 
-2 — —4  l=2'-6 2467 -8 
i 7) 1, =2.3 12 =-3 9 18 45 
iz atiead 
22, A= 6 flO, I A= he 1 LAYS 2 =? 1K OF 40. Pe] 2. 1 aa -2 4 6}, A=PDP™ =--/0 0 0 
-!| Oil 1 2 5 | 3 6 15 
1 -! J I =! 0 
P=| 0 -1 IfP'=|1 -1 1 31. Eigenvalues of B are 24, + (1/A,) - 1,7 = 1, 2,3, 4 or 2, - 4, 7/2, -11/2. |B] = product of 
=) ¢€ @ r 01 eigenvalues of B = 154. 
32. Eigenvalues of B are A; + Ae. - (1A), 7 = 1, 2, 3, or 1, 11/2, 1. Trace of B = sum of 


23. 21543, - 1, 3 ee, 12.0, 17.1. oF. : 
' | ; Min 2 eigenvalues of B = 15/2. 





+p 


33. Premultiply Ax = Ax by p' and substitute x = Py. 








35, 


36, 
37 


jg, 
39, 


40, 
41, 
42, 


43, 


44, 


45, 


46, 


47. 


49, 


SI. 


52, 
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Let 4 be an figenvalue and x be the corresponding eigenvector ‘oe = rE Ax = Ax. 
Pre-multiply by Av’ and substitute x = Ay. We get BAy = Ay. Therefore, IS also an 


eigenvalue of BA and eigenvectors are related by x = Ay. 
~ : : -1 ro =| — 
Let A be an eigenvalue and x be the corresponding eigenvector of A’'B, thal is A~'By = Ax. 


Premultiply by A and set x = A“'y, We obtain BA“'y = Ay. Therefore, A is also an eigenvalue 


of BA! with the corresponding eigenvector y = Ax. 

From Ax = Ax, we obtain A‘x = A“x = 0. Therefore, #4 = 0 or A = 0, since x # ), 

Since A is a diagonalizable matrix, there exists a non-singular matrix P such ta PAP =p 
and the cigenvalues of A and D are same. We have PUA‘P = D*. Since A‘ = A, We get 
P’'AP = D?. Therefore, we obtain D? ~ D = 0. Thus D = 0 or D = I. Hence, the eigenvalues 
Of A are 0 or J. 


Simplify the right hand side and set the off-diagonal clement to zero. 


Since A and B are similar, we have A = P-'BP. From this equation, show that A! = p-'p-ip 


and A™ = P"'B"P. Also [Al = |P""||BI|P| = |BI. 

We have A = A? and B = BY. Therefore, (AB)’ = BTAT @ BA. 

(ATA)T = ATA, 

Ler A7A™' hea symmetric matrix, We have (A7A7')! = (A-')7A AA, or (A"')7A? = AT of 

A* @ (A")®, Now, let A? = (A7)?, We have AA = ATAT => A= ATATAT => A(AT)! = AAT. 

Or ACA )T mm (AAT) T ow ql? Therefore, A’A™' is symmetric. 

Since A is symmetric, we have 

P= ACA = ATAT = (Pppy* (PDP) 7 = (PD™P-') ((P-') "DP7), since D? = p. This result 
is truc only when PP "')T mw | oe po! a p’, 

Let A and B be the orthogonal matrices, that is Av! = AT and B-! = B’, Then (AB)? = BAT 
= BUA = (apy, 

A= al gives AA’ = I, We Obtain conditions as +m 
Il, + mymy + nny = 0, Mls + mymy + nyny = 0, ily + mym, 
Since A is an Orthogonal matrix, we have Av! = Al Hence, [Avy = [A’| = |A| or I/|A| = 

[A] = JA]? = 1 of JA] = 4 4. 

Let A and yt be two distinct cigenvalues and x, y be the corresponding eigenvectors. We have. 
Ax ~ Ax and Ay « My. From the first equation, we get x7A7 = Ay! or xTA = Axl, 
Postmultiplying by y, we obtain x’ Ay = Ax'y. From the second equation, we get x’ Ay = px'y, 
Subtracting the two resulls, we obtain (A - xy = 0, which 


7 We 18 1d and 


r'y = 0 since A Me, 


There exists an orthogonal matrix P such that PAP = D. Now. A = PDP“! = PDP’, since 
P is orthogonal. We have AT » (PDP’)? = PH PT » pppr .. A, since a diagonal matrix is 
always symmetric. 

Let z= U + fV, where U ¢ 0, V #0 be rea} vectors, Then 

3" Az = (UTAU + VAY) 4 MUTAV ~ ¥7AU) « UTAU + Vlay > 9 

since UTAV = (UTAV)? w yTaty « V"AU, 
Let the vectors a, b be transformed to Vectors u, v respectively. Then 


(uveurve i *¥ = (Al)’ (Ab) = BT ATAD™ Gb mas b, 


—_— -— 
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53. (1) No. (ii) Yes. (interchange rows 2 and 3 followed by interchange of columns 2 and 3}, 
U, = (i, 3}. P u, = 12, 4}. 


a b\\ x, 


h c XZ 


r _ ela h 3 
54. x Ax = [x,, x3] = ax) + 2bx\x, + ex} 


= a(x, + bx./ay + x (ac - h*yia"| > 0, for all Ky, X3. 


Therefore, a > 0, ac — b’ > 0, 


2 1 3| x 
5S. SAX = [x 5, 00) 13 A ot X3 
—| l 2 Xy r. 


= 2x} - 2xyx, + Qxyx, + 4x3 + 2x} = (x, ~ x,)? + (x, + xs) + 3x3 + x2 > 9, 
56. All the leading minors are not positive. It can also be verified that all the eigenvalues até NOL positive. 


1 -1 0 5S i 3} 1 i ~4| 
Sh. is] =f 2 ) 58.| 1 1 4 59. |-i 0 21. 
& Ss | as 4TH =—4 -2j | 
1 -1-2i 9g 2 3445 0 
60. |-!4+2i | ~24y|. 61.|3-4i -3 2-j 62. y\ + Sy, - Sy. 
Oo -2-33 06 0 2+: oO ‘ 
63. yj + 3y} - 297. 64. yj + yh + 4y2. 65. 8y) + 2y4 + 2). 
66, 6.1713. 67. 5.59. 68. 2. 
69. 5.312, 
“a 0.19795 -—0.98021 p = | 045101 0 Si 0.94237 033458] ° 
. 0.98022 019795] 0 0.62006 |" 0.33458 -094237\ 
"1. P 052573 O.87065 D 3.61803 0 0 —0.0898| 0.99596 
: ~087065 -052573\" 0 138197 |’ 0.99596 0.08981 |' 
fe W3 ows we 
12. P= | I "ga 6 DON Ge —~VJ2 0 vV2 |. 
wv2\t -1 o 00 We -2wWe6e we 
| 
30 0 [2/3 =2/3 1/37 
723. P=O',d=|0 6 0|,Q=| 2/3 -1/3 273), 
009 —i3 23 273 
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75 P= eI i} “fF 0 0 1/14 3/J14 2/14 
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Exercise 3,5 
l. {@,b,clia=ph ==) (lad, e) lasten 0,5 +4c=0)}, {(0, 0, 0)}. 
2. {(-1, 3, 5)"}, 
3. Basis of (5, 4 So) = (1, 5, 37}: 1. 3. 
4. Reg 4 & ‘S11 S) = ((0, & 0)7}. Not a direct sum. 
5. (SAS) = ((0, 0, 0)").R=s5.@ Sy 
6 B=5, 45, (s, 


MY S>) = {(0, 0, a)"}. Not a direct sum. 
iti 


8. A basis of S, : {(x, y)} = {(1, 1,-1), (0, 1, 1)}. A basis of R° : {(x, y, e,)}. Complemetary subspace 
is S = span {e€;} = span {(qr, 0, O)}, & arbitrary, We can also take § = span {e,}, or § = Span{e,} as 
complementary subspaces. 


9. A basis S, : {(x, y)} = {(1, 0, -1), (0, -1. 1)}. A basis of R3 - {(X, y, e,)}. Complementary subspace 
is S= span{e,} = span {(a, 0,0)}, a arbitrary. We can also take § = span{e,}, or § = span{e,} as 
complementary subspaces. 

10, (IN2)(1, -1, 09"), (ING)(A, 1, -2)7 (IV3)(1, 1, 1)7. 


J 


11. (1/N3)(1, 1, 1)”, (1/V6)(1, -2, 1) (AV2)(1, 0, =1)7. 
12. (1/V2)(0, 1, -1)". (1/N6)(-2, -1, -1)7 (1N3)(-1, 1, 1)7 


13. (1N2)(1, 0, 1)", (1V6)(1, 2,~1)’, (IN3)(1, =1, -1)7, 


(WN3)(1, 1, 0, 197, (0, 0, 1, 0)", NB)CA, 1, 0, -2)', (WN2)\(1, =1, 0, 07 
15. (1N6)(2, 1, 0, 1)", (1N30)(-1, -2, 3. 4)", (1N630)(-8, 19. 14, 


1 


= 
> 


~3)', (1/V21294)(65, —52. 91. 78)" 





Be ; 
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wrt rey Mathoeiani ‘ 
” V\ f-4i\ 7 o 
1 y | 
i) fanny 
Oo; \ @ 1 ral PON Orthogonal weg in C" and “ | ir 
~ ard | 4/4 ; 
wid 
! 
“TH an orthonormal set in (' : 
Orthonormal ) 


ane 
unitary system of vectors 


Lt | af © 4 
vor for , , 
ms aN Orthanormal ya) Let w.. a), a. he 
rey rif veuloy ‘. if ' a tT VA Tipsy iti in" 


Then, this 


i, 7 i, i r i. : : 
| : 
J Lin i he i rf | ‘_ * | 
| | | oT if 


Im « 
Clin 19 

i.e, we } 7 
matrices. W Wve defined symmetric 


e now def 
define a few more special tre 


Orthogonal matrices 


show symmetry 


A real rr 
natin A is orthapomal if A’ = A" A simp) 
“me cxample 
is 


Loe iu in al } 


‘in® con 


A = 


A line 
af transformation in which 


orthogenal transformation the matrix of transformation 


"an 
orthogonal matrix is called an 


Wy ’ i ) i ) ;' 


Vifary iMate A 
trix ts same “wt "ITA 
as orthogonal matna If A is real, then 


irenfornanio trans format 
n pon mh @ uNitary matrix is called a unitary 


We note the following: 


ar fi, since 


(ar iB)’ « | 
A+ PR) iad +f)’ aa’ + pRB eaAa+ fp 


~ 
2. Fogenvalues and A 
cigenvectors of 
genvectors of A are the conjugates of the crygenvalues and eigenvecion 


of A, since 
Ay ~ Aw pives At = AiG 
\, The wveree of a unit 
) | writary (orthogonal) matrt , vet! = 
te B< A". Then : atrix is unitary (orthogonal) We have A’! = A’ 


| ' = = A’ 4 " 
B A= (A) (Ay) «tay =B 
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